-- Logs begin at Thu 2022-07-21 19:07:51 UTC, end at Thu 2022-07-21 20:29:57 UTC. -- Jul 21 19:55:39.454194 dv-cinder-850548-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 21 19:55:39.463522 dv-cinder-850548-2-iscsi devstack@n-api.service[103799]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 21 19:55:39.465357 dv-cinder-850548-2-iscsi devstack@n-api.service[103799]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 21 19:55:39 2022] *** Jul 21 19:55:39.465357 dv-cinder-850548-2-iscsi devstack@n-api.service[103799]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 21 19:55:39.465357 dv-cinder-850548-2-iscsi devstack@n-api.service[103799]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 21 19:55:39.465357 dv-cinder-850548-2-iscsi devstack@n-api.service[103799]: nodename: dv-cinder-850548-2-iscsi Jul 21 19:55:39.465357 dv-cinder-850548-2-iscsi devstack@n-api.service[103799]: machine: x86_64 Jul 21 19:55:39.465357 dv-cinder-850548-2-iscsi devstack@n-api.service[103799]: clock source: unix Jul 21 19:55:39.465357 dv-cinder-850548-2-iscsi devstack@n-api.service[103799]: pcre jit disabled Jul 21 19:55:39.465357 dv-cinder-850548-2-iscsi devstack@n-api.service[103799]: detected number of CPU cores: 4 Jul 21 19:55:39.465357 dv-cinder-850548-2-iscsi devstack@n-api.service[103799]: current working directory: / Jul 21 19:55:39.465357 dv-cinder-850548-2-iscsi devstack@n-api.service[103799]: detected binary path: /usr/bin/uwsgi-core Jul 21 19:55:39.465357 dv-cinder-850548-2-iscsi devstack@n-api.service[103799]: your processes number limit is 47680 Jul 21 19:55:39.465357 dv-cinder-850548-2-iscsi devstack@n-api.service[103799]: your memory page size is 4096 bytes Jul 21 19:55:39.465357 dv-cinder-850548-2-iscsi devstack@n-api.service[103799]: detected max file descriptor number: 2048 Jul 21 19:55:39.465357 dv-cinder-850548-2-iscsi devstack@n-api.service[103799]: lock engine: pthread robust mutexes Jul 21 19:55:39.466999 dv-cinder-850548-2-iscsi devstack@n-api.service[103799]: thunder lock: enabled Jul 21 19:55:39.466999 dv-cinder-850548-2-iscsi devstack@n-api.service[103799]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 21 19:55:39.466999 dv-cinder-850548-2-iscsi devstack@n-api.service[103799]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 21 19:55:39.511265 dv-cinder-850548-2-iscsi devstack@n-api.service[103799]: Python main interpreter initialized at 0x5572fdca89c0 Jul 21 19:55:39.511265 dv-cinder-850548-2-iscsi devstack@n-api.service[103799]: python threads support enabled Jul 21 19:55:39.511265 dv-cinder-850548-2-iscsi devstack@n-api.service[103799]: your server socket listen backlog is limited to 100 connections Jul 21 19:55:39.511265 dv-cinder-850548-2-iscsi devstack@n-api.service[103799]: your mercy for graceful operations on workers is 90 seconds Jul 21 19:55:39.511658 dv-cinder-850548-2-iscsi devstack@n-api.service[103799]: mapped 403077 bytes (393 KB) for 2 cores Jul 21 19:55:39.511735 dv-cinder-850548-2-iscsi devstack@n-api.service[103799]: *** Operational MODE: preforking *** Jul 21 19:55:39.511949 dv-cinder-850548-2-iscsi devstack@n-api.service[103799]: *** uWSGI is running in multiple interpreter mode *** Jul 21 19:55:39.511949 dv-cinder-850548-2-iscsi devstack@n-api.service[103799]: spawned uWSGI master process (pid: 103799) Jul 21 19:55:39.512158 dv-cinder-850548-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 21 19:55:39.513937 dv-cinder-850548-2-iscsi devstack@n-api.service[103799]: spawned uWSGI worker 1 (pid: 103800, cores: 1) Jul 21 19:55:39.513937 dv-cinder-850548-2-iscsi devstack@n-api.service[103799]: spawned uWSGI worker 2 (pid: 103801, cores: 1) Jul 21 19:55:39.513937 dv-cinder-850548-2-iscsi devstack@n-api.service[103799]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 21 19:55:40.178572 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 21 19:55:40.181594 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 21 19:55:41.301798 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 19:55:41.301798 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: from cryptography.utils import int_from_bytes Jul 21 19:55:41.302479 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 19:55:41.302479 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: from cryptography.utils import int_from_bytes Jul 21 19:55:41.302936 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 19:55:41.302936 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: from cryptography.utils import int_from_bytes Jul 21 19:55:41.303105 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 19:55:41.303105 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: from cryptography.utils import int_from_bytes Jul 21 19:55:43.818316 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 21 19:55:43.818865 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 21 19:55:43.819077 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 21 19:55:43.819426 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 21 19:55:43.819509 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 21 19:55:43.819586 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 21 19:55:43.819709 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 21 19:55:43.819852 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 21 19:55:43.820099 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.820222 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 21 19:55:43.820425 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.820512 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 21 19:55:43.820747 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.820883 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.821092 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.821213 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.821424 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.821525 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.821740 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.821838 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.822063 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.822159 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.822383 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.822476 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.822711 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.822802 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.822973 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.823110 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.823365 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.823464 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.823690 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.823788 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850548-2-iscsi {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.824013 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.824102 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.824318 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.824405 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850548-2-iscsi {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.824630 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.824714 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.824951 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.825035 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.825259 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.825355 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.825577 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.825670 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.825887 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.825996 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.826214 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.826385 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.826524 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.826823 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.827042 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.827184 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.827363 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.827475 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.827672 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.827792 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.827986 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.828115 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.828327 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.828420 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.828706 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.828791 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.829017 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.829103 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.829342 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.829434 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.829653 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.829761 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.830026 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.830119 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850548-2-iscsi {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.830343 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.830436 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.830657 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.830752 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850548-2-iscsi {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.830971 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.831089 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.831388 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.831475 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.831707 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.831854 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.832015 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.832109 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.832337 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.832429 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.832663 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.832756 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.832974 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.833067 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.833316 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.833471 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.833639 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.833735 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.834021 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.834122 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.834282 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.834367 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.834585 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.834677 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.834896 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.834989 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.835231 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.835380 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.835544 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.835640 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.835852 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.835950 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.836160 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.836258 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.836935 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.837037 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.837249 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.837335 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.837538 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.837622 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.837849 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.837993 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.838172 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.838260 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.838436 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.838529 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.838686 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.838807 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.839012 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.839130 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.839323 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.839426 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.839647 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.839735 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.839953 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.840043 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.840262 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.840348 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.840569 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.840661 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.840872 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.840956 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.841180 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.841266 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.841485 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.841568 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.841791 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.841894 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.842096 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.842181 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.842404 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.842490 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.842722 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.842823 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.843062 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.843152 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.843363 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.843447 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.843674 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.843772 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.843995 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.844094 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.844307 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.844419 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.844897 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.844999 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.845208 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.845293 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.845512 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.845603 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.845830 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.845927 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.846216 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.846313 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.846457 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.846543 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.846762 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.846849 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.847090 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.847180 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.847399 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.847495 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.847709 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.847797 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.848019 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.848102 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.848270 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.848355 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.848572 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.848672 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.848881 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.848966 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.849185 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.849269 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.849491 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.849576 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.849797 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.849891 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.850102 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.850202 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.850400 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.850531 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.850706 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.850798 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.851008 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.851160 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.851336 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.851429 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.851646 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.851732 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.851955 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.852049 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.852825 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.852919 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.853135 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.853238 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.853443 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.853541 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.853749 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.853846 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.854055 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.854140 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.854363 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.854461 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.854674 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.854757 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.854980 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.855117 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.855310 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.855406 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.855617 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.855703 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.855925 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.856021 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.856230 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.856381 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.856537 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.856623 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.856849 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.856935 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.857152 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.857253 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.857457 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.857550 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.857768 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.857852 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.858074 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.858160 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.858380 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.858466 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.858687 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.858779 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.858994 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.859147 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.859327 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.859419 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.859628 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.859712 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.859938 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.860025 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.860243 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.860326 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.860546 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.860679 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.860850 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.860937 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.861153 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.861238 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.861455 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.861549 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.861757 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.861841 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.862061 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.862145 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.862362 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.862454 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.862667 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.862755 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.862971 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.863083 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.863310 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.863411 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.863618 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.863703 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.863925 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.864013 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.864231 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.864325 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.864542 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.864640 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.864861 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:55:43.864946 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.865196 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.865291 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.865527 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.865612 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.865863 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.865949 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.866184 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.866269 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.866507 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.866602 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.866821 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.866915 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.867160 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.867252 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.867476 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.867561 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.867818 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.867921 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.868130 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.868223 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.868448 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.868533 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.868762 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.868855 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.869074 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.869172 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.869392 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.869499 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.869707 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.869794 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.870024 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.870111 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.870341 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.870427 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.870653 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.870797 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.870972 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.871108 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.871310 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.871406 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.871630 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.871725 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.871943 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.872027 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.872271 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.872355 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.872586 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.872680 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.872917 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.873001 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.873246 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.873331 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.873566 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.873659 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.873877 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.873960 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.874189 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.874274 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.874500 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.874642 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.874810 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.874902 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.875147 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.875249 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.875473 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.875568 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.875794 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.875878 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.876109 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.876201 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.876423 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.876523 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.876738 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.876842 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.877045 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.877137 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.877358 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.877445 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.877671 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.877763 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.877986 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.878080 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.878307 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.878399 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.878622 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.878708 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.878939 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.879070 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.879278 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.879364 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.879592 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.879690 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.879903 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.879998 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.880209 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.880293 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.880518 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.880601 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.880823 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.880924 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.881128 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.881213 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.881432 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.881523 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.881743 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.881836 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.882052 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.882138 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.882370 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.882454 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.882698 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.882784 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.883006 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.883107 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.883371 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.883456 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.883685 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.883772 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.883997 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.884081 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.884306 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.884391 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.884614 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.884739 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.884922 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.885007 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.885228 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.885313 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.885537 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.885627 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.885854 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.885946 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.886162 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.886256 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.886488 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.886574 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.886799 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.886903 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.887128 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.887231 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.887448 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.887541 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.887762 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.887849 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.888077 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.888171 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.888390 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.888476 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.888703 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.888797 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.889017 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.889111 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.889332 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.889425 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.889644 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.889731 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.889962 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.890048 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.890275 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.890368 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.890592 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.890678 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.890919 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.891007 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.891255 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.891340 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.891577 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.891663 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.891884 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.891971 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.892196 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.892281 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.892501 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.892596 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.892808 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.892899 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.893115 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.893199 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.893424 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.893628 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.893721 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.893798 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.894019 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.894152 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.894322 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.894417 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.894627 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.894712 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.894934 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.895062 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.895266 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.895366 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.895576 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.895662 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.895880 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.895971 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.896186 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.896302 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.896489 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.896575 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.896794 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.896935 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.897101 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.897188 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.897446 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.897531 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.897756 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.897844 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.898093 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.898180 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.898419 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.898505 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.898735 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.898828 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.899611 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.899700 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.899926 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.900011 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.900241 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.900327 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.900555 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.900641 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.900866 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.900950 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.901176 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.901274 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.901486 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.901578 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.901805 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.901890 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.902117 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.902214 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.902437 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.902522 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.902748 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.902831 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.903092 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.903198 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.903402 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.903488 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.903718 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.903803 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.904025 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.904120 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.904343 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.904439 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.904684 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.904777 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.905008 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.905100 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.905322 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.905408 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.905638 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.905723 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.905948 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.906035 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.906262 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.906361 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.906572 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.906663 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.906881 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.906966 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.907216 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.907302 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.907527 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.907622 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.907844 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.907930 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.908151 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.908236 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.908470 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.908554 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.908778 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.908872 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.909098 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.909192 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.909406 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.909499 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.909720 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.909812 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.910025 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.910117 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.910343 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.910437 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.910670 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.910754 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.910983 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.911088 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.911329 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.911423 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.911641 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.911734 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.911953 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.912038 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.912265 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.912358 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.912573 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.912658 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.912881 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.912973 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.913188 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.913279 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.913498 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.913592 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.913807 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.913898 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.914116 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.914212 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.914424 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.914512 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.915303 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.915413 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.915618 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.915707 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.915927 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.916011 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.916234 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.916319 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.916540 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.916626 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.916846 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.916932 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.917160 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.917255 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.917484 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.917568 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.917795 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.917887 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.918109 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.918207 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.918417 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.918503 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.918726 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.918812 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.919041 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.919142 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.919355 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.919452 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.919661 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.919747 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.919964 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.920112 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.920268 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.920360 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.920571 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.920656 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.920900 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.920986 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.921211 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.921295 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.921516 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.921602 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.921830 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.921923 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.922145 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.922237 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.922452 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.922537 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.922761 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.922846 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.923104 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.923192 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.923414 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.923499 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.923724 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.923810 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.924038 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.924136 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.924346 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.924486 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.924657 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.924755 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.924967 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.925051 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.925276 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.925367 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.925586 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.925672 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.925894 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.925979 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.926207 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.926301 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.926514 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.926608 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.926822 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.926918 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.927156 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.927264 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.927469 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.927721 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.927806 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.928061 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.928339 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.928427 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.928679 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.928763 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.928995 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.929090 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.929316 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.929405 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.929635 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.929721 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.929955 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.930043 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.930313 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.930411 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.930641 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.930736 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.930955 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.931071 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.931292 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.931393 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.931604 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.931691 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.931915 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.932001 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.932222 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.932306 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.932529 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.932616 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.932834 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.932926 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.933140 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.933227 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.933445 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.933539 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.933751 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.933845 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.934054 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.934161 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.934359 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.934445 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.934664 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.934756 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.934969 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.935120 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.935309 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.935396 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.935617 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.935705 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.935935 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.936029 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.936242 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.936334 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.936544 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.936629 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.936849 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.936943 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.937153 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.937245 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.937458 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.937550 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.937762 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.937856 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.938104 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.938196 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.938410 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.938496 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.938748 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.938837 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.939088 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.939187 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.939400 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.939486 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.939731 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.939825 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.940036 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.940121 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.940344 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.940430 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.940650 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.940737 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.940954 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.941038 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.941258 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.941345 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.941561 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.941649 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.941893 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.942009 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.942175 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.942274 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.942522 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.942682 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.942787 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.942874 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.943115 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.943222 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.943426 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.943511 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.943728 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.943812 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.944035 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.944133 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.944341 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.944426 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.944643 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.944726 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.944948 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.945048 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.945249 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.945334 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.945552 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.945647 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.945887 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.945985 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.946198 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.946283 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.946499 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.946585 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.946810 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.946896 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.947142 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.947230 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.947449 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.947535 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.947754 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.947841 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.948059 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.948145 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.948365 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.948450 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.948667 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.948754 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.948974 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.949060 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.949279 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.949375 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.949584 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.949669 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.949889 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.949976 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.950196 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.950290 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.950499 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.950584 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.950804 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.950898 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.951133 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.951233 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.951440 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.951565 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.951751 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.951836 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.952054 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.952214 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.952366 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.952451 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.952670 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.952754 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.952973 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.953059 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.953276 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.953368 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.953580 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.953666 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.953882 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.953968 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.954184 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.954269 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.954487 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.954580 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.954789 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.954875 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.955119 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.955209 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.955426 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.955512 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.955732 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.955819 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.956034 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.956127 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.956340 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.956435 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.956642 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.956733 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.956948 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.957034 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.957252 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.957354 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.957597 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.957682 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.957905 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.957990 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.958229 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.958323 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.958548 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.958634 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.958860 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.958944 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.959197 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.959296 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.959510 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.959602 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.959815 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.959900 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.960128 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.960214 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.960434 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.960521 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.960745 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.960838 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.961052 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.961140 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.961360 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.962036 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.962218 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.962312 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.962532 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.962619 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.962845 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.962938 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.963195 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.963284 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.963521 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.963617 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.963849 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.963935 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.964156 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.964249 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.964468 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.964555 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.964775 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.964904 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.965082 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.965176 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.965391 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.965477 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.965699 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.965828 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.966009 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.966103 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.966319 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.966404 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.966629 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.966713 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.966943 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.967082 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.967278 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.967362 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.967584 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.967669 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.967893 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.967990 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.968201 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.968287 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.968505 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.968598 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.968812 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.968906 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.969120 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.969207 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.969424 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.969516 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.969987 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.970076 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.970291 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.970383 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.970597 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.970682 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.970900 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.970986 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.971235 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.971351 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.971548 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.971665 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.971974 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.972062 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.972277 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.972361 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.972586 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.972679 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.972892 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.972985 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.973203 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.973289 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.973514 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.973607 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.973820 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.973911 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.974131 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.974223 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.974437 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.974530 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.974834 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.974916 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.975176 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.975266 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.975484 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.975583 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.975789 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.975874 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.976094 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.976185 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.976401 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.976495 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.976707 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.976793 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.977027 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.977139 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.977373 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.977459 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.977680 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.977765 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.977987 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.978072 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.978312 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.978406 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.978616 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.978728 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.978936 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.979064 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.979377 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.979471 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.979692 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.979777 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.980001 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.980095 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.980393 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.980485 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.980719 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.980806 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.981030 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.981123 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.981355 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.981440 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.981664 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.981749 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.981979 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.982156 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.982291 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.982391 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.982606 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.982693 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.982917 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.983002 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.983253 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.983354 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.983570 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.983659 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.983877 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.983971 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.984192 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.984286 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.984499 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.984593 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.984819 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.984906 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.985143 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.985229 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.985458 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.985551 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.985783 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.985869 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.986170 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.986263 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.986495 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.986581 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.986823 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.986916 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.987167 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.987258 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.987478 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.987565 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.987791 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.987879 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.988105 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.988199 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.988413 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.988512 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.988739 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.988834 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.989053 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.989178 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.989363 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.989454 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.989669 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.989763 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.989978 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.990065 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.990287 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.990373 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.990595 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.990688 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.990905 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.990999 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.991235 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.991339 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.991561 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.991654 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.991867 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.991960 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.992191 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.992283 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.992508 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.992596 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.993336 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.993422 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.993663 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.993748 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.993975 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.994068 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.994284 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.994379 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.994593 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.994679 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.994897 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.994983 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.995231 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.995319 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.995540 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.995627 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.995888 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.995976 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.996199 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.996285 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.996522 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.996616 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.996847 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.996945 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.997178 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.997264 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.997493 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.997588 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.997810 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.997895 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.998131 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.998218 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.998453 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.998551 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.998759 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.998844 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.999088 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.999179 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.999404 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.999505 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.999709 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:43.999794 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.000015 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.000142 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.000320 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.000416 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.000627 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.000713 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.000930 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.001018 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.001235 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.001322 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.001538 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.001623 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.001846 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.001932 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.002153 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.002239 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.002474 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.002566 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.002778 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.002870 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.003105 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.003205 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.003416 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.003502 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.003719 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.003818 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.004028 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.004114 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.004332 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.004418 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.004676 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.004779 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.004980 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.005072 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.005307 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.005391 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.005622 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.005716 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.005963 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.006055 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.006260 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.006345 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.006572 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.006672 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.006889 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.006974 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.007228 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.007315 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.007545 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.007639 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.007862 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.007947 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.008179 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.008286 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.008544 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.008631 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.008861 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.008961 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.009177 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.009271 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.009490 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.009578 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.009804 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.009889 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.010118 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.010328 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.010422 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.010663 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.010944 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.011060 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.011300 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.011397 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.011617 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.011710 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.011929 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.012014 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.012240 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.012334 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.012553 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.012638 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.012864 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.012949 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.013176 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.013276 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.013484 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.013569 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.013795 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.013882 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.014106 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.014202 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.014428 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.014521 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.014752 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.014840 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.015100 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.015191 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.015421 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.015509 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.015739 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.015827 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.016053 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.016139 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.016367 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.016462 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.016683 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.016782 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.017008 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.017095 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.017326 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.017421 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.017639 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.017734 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.017953 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.018041 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.018265 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.018353 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.018578 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.018665 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.018890 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.018984 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.019228 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.019313 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.019542 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.019632 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.019853 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.019938 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.020165 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.020257 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.020477 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.020564 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.020793 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.020878 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.021109 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.021204 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.021437 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.021531 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.021753 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.021837 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.022071 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.022228 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.022391 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.022485 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.022706 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.022913 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.023039 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.023256 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.023568 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.023656 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.023914 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.024030 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.024250 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.024338 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.024567 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.024654 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.024909 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.025010 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.025205 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.025299 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.025515 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.025608 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.025825 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.025919 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.026139 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.026234 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.026447 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.026531 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.026752 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.026836 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.027096 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.027186 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.027406 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.027492 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.027708 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.027805 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.028030 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.028114 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.028335 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.028428 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.028656 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.028876 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.028965 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.029222 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.029486 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.029581 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.029829 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.029924 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.030147 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.030240 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.030475 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.030568 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.030784 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.030870 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.031133 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.031233 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.031445 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.031530 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.031755 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.031850 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.032073 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.032166 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.032383 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.032470 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.032687 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.032773 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.032995 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.033090 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.033299 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.033385 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.033608 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.033695 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.033912 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.034000 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.034222 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.034330 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.034524 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.034617 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.034833 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.034920 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.035162 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.035265 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.035477 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.035562 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.035785 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.035869 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.036092 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.036186 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.036396 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.036481 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.036701 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.036787 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.037007 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.037102 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.037310 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.037396 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.037617 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.037702 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.037919 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.038014 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.038228 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.038314 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.038532 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.038617 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.038843 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.038931 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.039171 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.039259 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.039484 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.040091 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.040365 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.040693 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.040778 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.041001 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.041086 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.041309 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.041404 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.041627 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.041712 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.041939 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.042091 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.042266 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.042362 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.042585 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.042695 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.042900 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.043000 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.043249 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.043340 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.043568 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.043654 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.043883 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.044101 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.044232 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.044439 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.044553 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.044762 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.045091 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.045177 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.045422 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.045508 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.045731 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.045889 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.046040 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.046235 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.046330 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.046570 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.046664 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.046882 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.046974 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.047219 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.047309 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.047530 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.047616 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.047857 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.047945 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.048170 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.048266 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.048479 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.048571 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.048791 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.048879 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.049104 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.049192 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.049409 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.049494 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.049718 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.049817 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.050025 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.050118 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.050334 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.050419 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.050642 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.050736 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.050951 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.051055 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.051288 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.051375 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.051599 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.051695 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.051911 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.052001 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.052226 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.052313 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.052543 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.052631 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.052870 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.053006 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.053171 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.053267 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.053483 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.053570 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.053793 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.053886 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.054106 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.054192 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.054422 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.054510 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.054735 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.054820 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.055056 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.055179 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.055431 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.055591 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.055765 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.055908 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.056083 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.056231 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.056393 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.056553 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.056814 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.056910 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.057129 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.057225 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.057452 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.057538 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.057773 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.057859 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.058087 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.058175 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.058399 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.058484 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.058724 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.058811 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.059050 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.059140 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.059377 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.059463 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.059690 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.059776 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.060020 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.060109 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.060331 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.060416 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.060640 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.060733 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.060952 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.061037 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.061273 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.061407 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.061579 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.061674 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.061884 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.061977 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.062191 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.062277 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.062506 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.062602 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.062812 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.062906 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.063139 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.063239 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.063447 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.063543 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.063754 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.063839 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.064058 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.064144 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.064363 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.064449 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.064667 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.064760 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.064972 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.065064 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.065277 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.065364 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.065581 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.065668 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.065886 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.065970 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.066187 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.066273 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.066489 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.066574 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.066792 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.066884 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.067119 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.067215 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.067425 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.067523 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.067726 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.067821 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.068031 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.068125 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.068334 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.068421 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.068640 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.068741 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.068944 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.069038 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.069277 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.069363 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.069611 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.069704 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.069922 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.070008 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.070245 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.070331 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.070558 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.070656 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.071426 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.071524 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.071742 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.071827 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.072066 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.072163 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.072376 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.072462 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.072692 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.072778 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.073004 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.073091 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.073315 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.073399 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.073628 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.073716 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.073941 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.074036 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.074271 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.074384 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.074599 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.074686 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.074910 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.075007 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.075335 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.075433 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.075656 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.075754 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.075978 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.076064 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.076286 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.076373 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.076597 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.076690 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.076923 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.077010 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.077235 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.077328 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.077549 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.077648 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.077861 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.077946 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.078173 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.078283 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.078489 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.078608 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.078800 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.078926 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.079131 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.079255 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.079449 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.079581 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.079761 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.079893 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.080079 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.080223 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.080388 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.080501 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.080708 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.080844 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.081021 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.081165 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.081341 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.081536 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.081673 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.081801 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.081987 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.082233 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.082372 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.082521 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.082671 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.082807 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.082954 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.083160 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.083317 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.083442 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.083593 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.083757 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.083907 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.084038 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.084179 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 21 19:55:44.084318 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.084560 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.084871 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.085178 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:55:44.085422 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 21 19:55:44.146684 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: INFO dbcounter [None req-0f6a51d0-e8f4-4258-80a6-0cbbb51e8618 None None] Registered counter for database nova_api Jul 21 19:55:44.148472 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: INFO dbcounter [None req-3e0b368b-5cb5-4fc2-91ab-1b80bf70c6ad None None] Registered counter for database nova_api Jul 21 19:55:44.261253 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG oslo_db.sqlalchemy.engines [None req-0f6a51d0-e8f4-4258-80a6-0cbbb51e8618 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103801) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 19:55:44.267745 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG dbcounter [-] [103801] Writer thread running {{(pid=103801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 19:55:44.268621 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG oslo_db.sqlalchemy.engines [None req-3e0b368b-5cb5-4fc2-91ab-1b80bf70c6ad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103800) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 19:55:44.275425 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG dbcounter [-] [103800] Writer thread running {{(pid=103800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 19:55:44.323883 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.context [None req-0f6a51d0-e8f4-4258-80a6-0cbbb51e8618 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c67a2928-fd99-4ffe-bc44-a4ed319a28fe(cell1) {{(pid=103801) load_cells /opt/stack/nova/nova/context.py:464}} Jul 21 19:55:44.327820 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG oslo_concurrency.lockutils [None req-0f6a51d0-e8f4-4258-80a6-0cbbb51e8618 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 19:55:44.329394 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG oslo_concurrency.lockutils [None req-0f6a51d0-e8f4-4258-80a6-0cbbb51e8618 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 19:55:44.330204 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG oslo_concurrency.lockutils [None req-0f6a51d0-e8f4-4258-80a6-0cbbb51e8618 None None] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 19:55:44.331201 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.context [None req-3e0b368b-5cb5-4fc2-91ab-1b80bf70c6ad None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c67a2928-fd99-4ffe-bc44-a4ed319a28fe(cell1) {{(pid=103800) load_cells /opt/stack/nova/nova/context.py:464}} Jul 21 19:55:44.332358 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG oslo_concurrency.lockutils [None req-0f6a51d0-e8f4-4258-80a6-0cbbb51e8618 None None] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 19:55:44.334332 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: INFO dbcounter [None req-0f6a51d0-e8f4-4258-80a6-0cbbb51e8618 None None] Registered counter for database nova_cell0 Jul 21 19:55:44.335093 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG oslo_concurrency.lockutils [None req-3e0b368b-5cb5-4fc2-91ab-1b80bf70c6ad None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 19:55:44.337523 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG oslo_concurrency.lockutils [None req-3e0b368b-5cb5-4fc2-91ab-1b80bf70c6ad None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 19:55:44.338345 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG oslo_concurrency.lockutils [None req-3e0b368b-5cb5-4fc2-91ab-1b80bf70c6ad None None] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 19:55:44.338719 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: INFO dbcounter [None req-0f6a51d0-e8f4-4258-80a6-0cbbb51e8618 None None] Registered counter for database nova_cell1 Jul 21 19:55:44.340511 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG oslo_concurrency.lockutils [None req-3e0b368b-5cb5-4fc2-91ab-1b80bf70c6ad None None] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 19:55:44.342494 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: INFO dbcounter [None req-3e0b368b-5cb5-4fc2-91ab-1b80bf70c6ad None None] Registered counter for database nova_cell0 Jul 21 19:55:44.346652 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: INFO dbcounter [None req-3e0b368b-5cb5-4fc2-91ab-1b80bf70c6ad None None] Registered counter for database nova_cell1 Jul 21 19:55:44.346903 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG oslo_db.sqlalchemy.engines [None req-0f6a51d0-e8f4-4258-80a6-0cbbb51e8618 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103801) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 19:55:44.349212 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG oslo_db.sqlalchemy.engines [None req-0f6a51d0-e8f4-4258-80a6-0cbbb51e8618 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103801) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 19:55:44.353867 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG dbcounter [-] [103801] Writer thread running {{(pid=103801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 19:55:44.354017 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG oslo_db.sqlalchemy.engines [None req-3e0b368b-5cb5-4fc2-91ab-1b80bf70c6ad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103800) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 19:55:44.355863 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG oslo_db.sqlalchemy.engines [None req-3e0b368b-5cb5-4fc2-91ab-1b80bf70c6ad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103800) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 19:55:44.359506 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG dbcounter [-] [103801] Writer thread running {{(pid=103801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 19:55:44.361994 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG dbcounter [-] [103800] Writer thread running {{(pid=103800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 19:55:44.363295 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG dbcounter [-] [103800] Writer thread running {{(pid=103800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 19:55:44.502579 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: INFO dbcounter [None req-0f6a51d0-e8f4-4258-80a6-0cbbb51e8618 None None] Registered counter for database nova_cell0 Jul 21 19:55:44.510216 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: INFO dbcounter [None req-3e0b368b-5cb5-4fc2-91ab-1b80bf70c6ad None None] Registered counter for database nova_cell0 Jul 21 19:55:44.511727 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG oslo_db.sqlalchemy.engines [None req-0f6a51d0-e8f4-4258-80a6-0cbbb51e8618 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103801) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 19:55:44.516292 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG dbcounter [-] [103801] Writer thread running {{(pid=103801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 19:55:44.518580 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG oslo_db.sqlalchemy.engines [None req-3e0b368b-5cb5-4fc2-91ab-1b80bf70c6ad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103800) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 19:55:44.522985 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG dbcounter [-] [103800] Writer thread running {{(pid=103800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 19:55:44.926809 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: WARNING keystonemiddleware.auth_token [None req-0f6a51d0-e8f4-4258-80a6-0cbbb51e8618 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 21 19:55:44.934159 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: WARNING keystonemiddleware.auth_token [None req-0f6a51d0-e8f4-4258-80a6-0cbbb51e8618 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 21 19:55:44.938840 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: WARNING keystonemiddleware.auth_token [None req-3e0b368b-5cb5-4fc2-91ab-1b80bf70c6ad None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 21 19:55:44.946585 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: WARNING keystonemiddleware.auth_token [None req-3e0b368b-5cb5-4fc2-91ab-1b80bf70c6ad None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 21 19:55:45.273032 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: WARNING keystonemiddleware.auth_token [None req-0f6a51d0-e8f4-4258-80a6-0cbbb51e8618 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 21 19:55:45.278983 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: WARNING keystonemiddleware.auth_token [None req-0f6a51d0-e8f4-4258-80a6-0cbbb51e8618 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 21 19:55:45.284163 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: WARNING keystonemiddleware.auth_token [None req-3e0b368b-5cb5-4fc2-91ab-1b80bf70c6ad None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 21 19:55:45.284281 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5572fdca89c0 pid: 103801 (default app) Jul 21 19:55:45.286293 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi [None req-0f6a51d0-e8f4-4258-80a6-0cbbb51e8618 None None] Calling method '>' {{(pid=103801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 19:55:45.287497 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: INFO nova.api.openstack.requestlog [None req-0f6a51d0-e8f4-4258-80a6-0cbbb51e8618 None None] 10.222.0.58 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001737 Jul 21 19:55:45.287975 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: [pid: 103801|app: 0|req: 1/1] 10.222.0.58 () {50 vars in 788 bytes} [Thu Jul 21 19:55:45 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 19:55:45.290129 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: WARNING keystonemiddleware.auth_token [None req-3e0b368b-5cb5-4fc2-91ab-1b80bf70c6ad None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 21 19:55:45.295332 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5572fdca89c0 pid: 103800 (default app) Jul 21 19:57:04.482707 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi [None req-0f6a51d0-e8f4-4258-80a6-0cbbb51e8618 None None] Calling method '>' {{(pid=103801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 19:57:04.484328 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: INFO nova.api.openstack.requestlog [None req-0f6a51d0-e8f4-4258-80a6-0cbbb51e8618 None None] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Jul 21 19:57:04.484328 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: [pid: 103801|app: 0|req: 2/2] 10.222.0.58 () {54 vars in 930 bytes} [Thu Jul 21 19:57:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 19:57:04.496856 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG dbcounter [-] [103800] Writing DB stats nova_api:SELECT=3 {{(pid=103800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:57:04.498321 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG dbcounter [-] [103800] Writing DB stats nova_cell0:SELECT=3 {{(pid=103800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:57:04.499353 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG dbcounter [-] [103800] Writing DB stats nova_cell1:SELECT=3 {{(pid=103800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:57:04.500374 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG dbcounter [-] [103800] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:57:05.380005 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi [None req-9ef53a30-a32f-440a-ad72-43b80aa28e8c admin admin] Calling method '>' {{(pid=103800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 19:57:05.409880 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: INFO nova.api.openstack.requestlog [None req-9ef53a30-a32f-440a-ad72-43b80aa28e8c admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.918100 Jul 21 19:57:05.410742 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: [pid: 103800|app: 0|req: 1/3] 10.222.0.58 () {60 vars in 1291 bytes} [Thu Jul 21 19:57:04 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 19:57:07.645651 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi [None req-0f6a51d0-e8f4-4258-80a6-0cbbb51e8618 None None] Calling method '>' {{(pid=103801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 19:57:07.646699 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: INFO nova.api.openstack.requestlog [None req-0f6a51d0-e8f4-4258-80a6-0cbbb51e8618 None None] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Jul 21 19:57:07.647374 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: [pid: 103801|app: 0|req: 3/4] 10.222.0.58 () {54 vars in 930 bytes} [Thu Jul 21 19:57:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 19:57:08.117390 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi [None req-07b814ea-dbe7-4d23-a868-c1dd39c78e72 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "name": "cirros256", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "disk": 1, "id": "c1"}} {{(pid=103800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 19:57:08.135235 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 19:57:08.135235 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: warnings.warn(msg) Jul 21 19:57:08.281351 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: INFO nova.api.openstack.requestlog [None req-07b814ea-dbe7-4d23-a868-c1dd39c78e72 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.628005 Jul 21 19:57:08.282060 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: [pid: 103800|app: 0|req: 2/5] 10.222.0.58 () {64 vars in 1282 bytes} [Thu Jul 21 19:57:07 2022] POST /compute/v2.1/flavors => generated 407 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 19:57:08.296842 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG dbcounter [-] [103801] Writing DB stats nova_api:SELECT=3 {{(pid=103801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:57:08.298095 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG dbcounter [-] [103801] Writing DB stats nova_cell0:SELECT=3 {{(pid=103801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:57:08.299372 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG dbcounter [-] [103801] Writing DB stats nova_cell1:SELECT=3 {{(pid=103801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:57:08.300258 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG dbcounter [-] [103801] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:57:08.506692 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi [None req-0c506178-6e80-4d56-bf76-c94588728a9b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 19:57:08.509167 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 19:57:08.509167 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: warnings.warn(msg) Jul 21 19:57:08.657844 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: INFO nova.api.openstack.requestlog [None req-0c506178-6e80-4d56-bf76-c94588728a9b admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.367117 Jul 21 19:57:08.667677 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: [pid: 103801|app: 0|req: 4/6] 10.222.0.58 () {64 vars in 1335 bytes} [Thu Jul 21 19:57:08 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 19:57:10.904067 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi [None req-07b814ea-dbe7-4d23-a868-c1dd39c78e72 admin admin] Calling method '>' {{(pid=103800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 19:57:10.905024 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: INFO nova.api.openstack.requestlog [None req-07b814ea-dbe7-4d23-a868-c1dd39c78e72 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Jul 21 19:57:10.905459 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: [pid: 103800|app: 0|req: 3/7] 10.222.0.58 () {54 vars in 930 bytes} [Thu Jul 21 19:57:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 19:57:11.582772 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi [None req-de9a3cfc-7c6a-4161-93f2-8be0e7858010 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "id": "d1", "disk": 5, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "vcpus": 1, "name": "ds512M"}} {{(pid=103801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 19:57:11.601910 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 19:57:11.601910 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: warnings.warn(msg) Jul 21 19:57:11.707242 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: INFO nova.api.openstack.requestlog [None req-de9a3cfc-7c6a-4161-93f2-8be0e7858010 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.795601 Jul 21 19:57:11.714990 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: [pid: 103801|app: 0|req: 5/8] 10.222.0.58 () {64 vars in 1282 bytes} [Thu Jul 21 19:57:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 19:57:11.721346 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi [None req-70075b80-9ce7-4339-928d-eae36b2a2147 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 19:57:11.722838 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 19:57:11.722838 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: warnings.warn(msg) Jul 21 19:57:11.813852 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: INFO nova.api.openstack.requestlog [None req-70075b80-9ce7-4339-928d-eae36b2a2147 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097010 Jul 21 19:57:11.814452 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: [pid: 103800|app: 0|req: 4/9] 10.222.0.58 () {64 vars in 1335 bytes} [Thu Jul 21 19:57:11 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 19:57:14.065772 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi [None req-de9a3cfc-7c6a-4161-93f2-8be0e7858010 admin admin] Calling method '>' {{(pid=103801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 19:57:14.066800 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: INFO nova.api.openstack.requestlog [None req-de9a3cfc-7c6a-4161-93f2-8be0e7858010 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Jul 21 19:57:14.067247 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: [pid: 103801|app: 0|req: 6/10] 10.222.0.58 () {54 vars in 930 bytes} [Thu Jul 21 19:57:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 19:57:14.464558 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi [None req-6d315174-1fcc-44e5-b93a-b4681de80516 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "swap": 0, "id": "d2", "name": "ds1G"}} {{(pid=103800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 19:57:14.552566 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: INFO nova.api.openstack.requestlog [None req-6d315174-1fcc-44e5-b93a-b4681de80516 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.478348 Jul 21 19:57:14.553155 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: [pid: 103800|app: 0|req: 5/11] 10.222.0.58 () {64 vars in 1282 bytes} [Thu Jul 21 19:57:14 2022] POST /compute/v2.1/flavors => generated 404 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 19:57:14.565067 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi [None req-5da37b12-038e-4ca1-853d-e5805519c8cf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 19:57:14.659207 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: INFO nova.api.openstack.requestlog [None req-5da37b12-038e-4ca1-853d-e5805519c8cf admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097712 Jul 21 19:57:14.659919 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: [pid: 103801|app: 0|req: 7/12] 10.222.0.58 () {64 vars in 1335 bytes} [Thu Jul 21 19:57:14 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 19:57:16.897588 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi [None req-6d315174-1fcc-44e5-b93a-b4681de80516 admin admin] Calling method '>' {{(pid=103800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 19:57:16.898540 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: INFO nova.api.openstack.requestlog [None req-6d315174-1fcc-44e5-b93a-b4681de80516 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Jul 21 19:57:16.898936 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: [pid: 103800|app: 0|req: 6/13] 10.222.0.58 () {54 vars in 930 bytes} [Thu Jul 21 19:57:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 19:57:17.348082 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi [None req-b2a28cb5-6179-44f8-b298-883b94bd631d admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "id": "d3", "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "ram": 2048, "disk": 10}} {{(pid=103801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 19:57:17.421285 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: INFO nova.api.openstack.requestlog [None req-b2a28cb5-6179-44f8-b298-883b94bd631d admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.516349 Jul 21 19:57:17.421756 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: [pid: 103801|app: 0|req: 8/14] 10.222.0.58 () {64 vars in 1282 bytes} [Thu Jul 21 19:57:16 2022] POST /compute/v2.1/flavors => generated 404 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 19:57:17.433853 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi [None req-5342c280-8504-441e-8522-ff9e44c39716 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 19:57:17.533179 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: INFO nova.api.openstack.requestlog [None req-5342c280-8504-441e-8522-ff9e44c39716 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.103020 Jul 21 19:57:17.533927 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: [pid: 103800|app: 0|req: 7/15] 10.222.0.58 () {64 vars in 1335 bytes} [Thu Jul 21 19:57:17 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 19:57:19.769682 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi [None req-b2a28cb5-6179-44f8-b298-883b94bd631d admin admin] Calling method '>' {{(pid=103801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 19:57:19.771914 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: INFO nova.api.openstack.requestlog [None req-b2a28cb5-6179-44f8-b298-883b94bd631d admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002645 Jul 21 19:57:19.772303 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: [pid: 103801|app: 0|req: 9/16] 10.222.0.58 () {54 vars in 930 bytes} [Thu Jul 21 19:57:19 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 19:57:20.208738 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi [None req-f853f665-9fdf-40cc-9c0f-d623bb7f5a27 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "ds4G", "id": "d4", "vcpus": 4, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 4096}} {{(pid=103800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 19:57:20.296238 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: INFO nova.api.openstack.requestlog [None req-f853f665-9fdf-40cc-9c0f-d623bb7f5a27 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.516044 Jul 21 19:57:20.296970 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: [pid: 103800|app: 0|req: 8/17] 10.222.0.58 () {64 vars in 1282 bytes} [Thu Jul 21 19:57:19 2022] POST /compute/v2.1/flavors => generated 404 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 19:57:20.310750 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi [None req-9a17f97f-7670-496a-939b-70b3a92794a9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 19:57:20.390106 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: INFO nova.api.openstack.requestlog [None req-9a17f97f-7670-496a-939b-70b3a92794a9 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.083636 Jul 21 19:57:20.391110 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: [pid: 103801|app: 0|req: 10/18] 10.222.0.58 () {64 vars in 1335 bytes} [Thu Jul 21 19:57:20 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 19:57:22.614516 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi [None req-f853f665-9fdf-40cc-9c0f-d623bb7f5a27 admin admin] Calling method '>' {{(pid=103800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 19:57:22.616310 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: INFO nova.api.openstack.requestlog [None req-f853f665-9fdf-40cc-9c0f-d623bb7f5a27 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002477 Jul 21 19:57:22.617049 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: [pid: 103800|app: 0|req: 9/19] 10.222.0.58 () {54 vars in 930 bytes} [Thu Jul 21 19:57:22 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 19:57:23.066343 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi [None req-ac613e77-7b2d-44e8-86e9-b45e31a3e874 admin admin] Calling method '>' {{(pid=103801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 19:57:23.090816 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: INFO nova.api.openstack.requestlog [None req-ac613e77-7b2d-44e8-86e9-b45e31a3e874 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.467974 Jul 21 19:57:23.091424 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: [pid: 103801|app: 0|req: 11/20] 10.222.0.58 () {60 vars in 1291 bytes} [Thu Jul 21 19:57:22 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 19:57:25.379300 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi [None req-f853f665-9fdf-40cc-9c0f-d623bb7f5a27 admin admin] Calling method '>' {{(pid=103800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 19:57:25.381144 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: INFO nova.api.openstack.requestlog [None req-f853f665-9fdf-40cc-9c0f-d623bb7f5a27 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002575 Jul 21 19:57:25.381688 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: [pid: 103800|app: 0|req: 10/21] 10.222.0.58 () {54 vars in 930 bytes} [Thu Jul 21 19:57:25 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 19:57:25.825784 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi [None req-4c940f7f-c0ab-4e0a-b463-a1214ca3c666 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "os-flavor-access:is_public": true, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "id": "1", "rxtx_factor": 1.0, "swap": 0, "ram": 512}} {{(pid=103801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 19:57:25.905584 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: INFO nova.api.openstack.requestlog [None req-4c940f7f-c0ab-4e0a-b463-a1214ca3c666 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.516204 Jul 21 19:57:25.906058 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: [pid: 103801|app: 0|req: 12/22] 10.222.0.58 () {64 vars in 1282 bytes} [Thu Jul 21 19:57:25 2022] POST /compute/v2.1/flavors => generated 402 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 19:57:25.922169 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi [None req-4633e46d-2cb8-449a-a1c7-f4d9f222034e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 19:57:26.002486 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: INFO nova.api.openstack.requestlog [None req-4633e46d-2cb8-449a-a1c7-f4d9f222034e admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.084787 Jul 21 19:57:26.003234 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: [pid: 103800|app: 0|req: 11/23] 10.222.0.58 () {64 vars in 1332 bytes} [Thu Jul 21 19:57:25 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 19:57:28.292032 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi [None req-4c940f7f-c0ab-4e0a-b463-a1214ca3c666 admin admin] Calling method '>' {{(pid=103801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 19:57:28.293045 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: INFO nova.api.openstack.requestlog [None req-4c940f7f-c0ab-4e0a-b463-a1214ca3c666 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Jul 21 19:57:28.293448 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: [pid: 103801|app: 0|req: 13/24] 10.222.0.58 () {54 vars in 930 bytes} [Thu Jul 21 19:57:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 19:57:28.689403 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi [None req-2de1bf64-ecfb-404a-8cd5-e30aef5d2809 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 1, "swap": 0, "ram": 2048, "name": "m1.small", "disk": 20, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2"}} {{(pid=103800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 19:57:28.780672 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: INFO nova.api.openstack.requestlog [None req-2de1bf64-ecfb-404a-8cd5-e30aef5d2809 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.481512 Jul 21 19:57:28.781225 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: [pid: 103800|app: 0|req: 12/25] 10.222.0.58 () {64 vars in 1282 bytes} [Thu Jul 21 19:57:28 2022] POST /compute/v2.1/flavors => generated 405 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 19:57:28.793609 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi [None req-8dd608ce-ed51-4e16-87ce-bd777d49af80 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 19:57:28.910255 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: INFO nova.api.openstack.requestlog [None req-8dd608ce-ed51-4e16-87ce-bd777d49af80 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.120208 Jul 21 19:57:28.911520 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: [pid: 103801|app: 0|req: 14/26] 10.222.0.58 () {64 vars in 1332 bytes} [Thu Jul 21 19:57:28 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 19:57:31.158461 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi [None req-2de1bf64-ecfb-404a-8cd5-e30aef5d2809 admin admin] Calling method '>' {{(pid=103800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 19:57:31.159432 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: INFO nova.api.openstack.requestlog [None req-2de1bf64-ecfb-404a-8cd5-e30aef5d2809 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Jul 21 19:57:31.159981 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: [pid: 103800|app: 0|req: 13/27] 10.222.0.58 () {54 vars in 930 bytes} [Thu Jul 21 19:57:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 19:57:31.527742 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi [None req-9e1284bb-d1fe-4ef9-b4b6-1db1c6165fa5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "swap": 0, "id": "3", "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 4096, "os-flavor-access:is_public": true, "name": "m1.medium"}} {{(pid=103801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 19:57:31.637534 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: INFO nova.api.openstack.requestlog [None req-9e1284bb-d1fe-4ef9-b4b6-1db1c6165fa5 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.471844 Jul 21 19:57:31.638090 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: [pid: 103801|app: 0|req: 15/28] 10.222.0.58 () {64 vars in 1282 bytes} [Thu Jul 21 19:57:31 2022] POST /compute/v2.1/flavors => generated 406 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 19:57:31.650417 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi [None req-611d64f3-6ce8-4f10-8eb2-c5a3bf501a32 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 19:57:31.749612 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: INFO nova.api.openstack.requestlog [None req-611d64f3-6ce8-4f10-8eb2-c5a3bf501a32 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.102883 Jul 21 19:57:31.750234 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: [pid: 103800|app: 0|req: 14/29] 10.222.0.58 () {64 vars in 1332 bytes} [Thu Jul 21 19:57:31 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 19:57:34.080665 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi [None req-9e1284bb-d1fe-4ef9-b4b6-1db1c6165fa5 admin admin] Calling method '>' {{(pid=103801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 19:57:34.081666 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: INFO nova.api.openstack.requestlog [None req-9e1284bb-d1fe-4ef9-b4b6-1db1c6165fa5 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Jul 21 19:57:34.082846 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: [pid: 103801|app: 0|req: 16/30] 10.222.0.58 () {54 vars in 930 bytes} [Thu Jul 21 19:57:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 19:57:34.530064 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi [None req-5906773a-8ab3-4393-86f9-51a2bbe79f55 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "vcpus": 4, "name": "m1.large", "swap": 0, "rxtx_factor": 1.0, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "4"}} {{(pid=103800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 19:57:34.591386 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG dbcounter [-] [103800] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:57:34.599691 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: INFO nova.api.openstack.requestlog [None req-5906773a-8ab3-4393-86f9-51a2bbe79f55 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.511022 Jul 21 19:57:34.613229 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi [None req-6e9a22bd-38f2-437c-ac49-bad60606b68c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 19:57:34.619163 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: [pid: 103800|app: 0|req: 15/31] 10.222.0.58 () {64 vars in 1282 bytes} [Thu Jul 21 19:57:34 2022] POST /compute/v2.1/flavors => generated 405 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 19:57:34.727230 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: INFO nova.api.openstack.requestlog [None req-6e9a22bd-38f2-437c-ac49-bad60606b68c admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.117611 Jul 21 19:57:34.728486 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: [pid: 103801|app: 0|req: 17/32] 10.222.0.58 () {64 vars in 1332 bytes} [Thu Jul 21 19:57:34 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 19:57:37.017157 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi [None req-5906773a-8ab3-4393-86f9-51a2bbe79f55 admin admin] Calling method '>' {{(pid=103800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 19:57:37.018176 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: INFO nova.api.openstack.requestlog [None req-5906773a-8ab3-4393-86f9-51a2bbe79f55 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Jul 21 19:57:37.018578 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: [pid: 103800|app: 0|req: 16/33] 10.222.0.58 () {54 vars in 930 bytes} [Thu Jul 21 19:57:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 19:57:37.464983 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi [None req-bebad3ef-dab0-4ece-8a61-cdda1ed5a55a admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "swap": 0, "vcpus": 8, "disk": 160}} {{(pid=103801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 19:57:37.523386 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: INFO nova.api.openstack.requestlog [None req-bebad3ef-dab0-4ece-8a61-cdda1ed5a55a admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.496152 Jul 21 19:57:37.525516 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: [pid: 103801|app: 0|req: 18/34] 10.222.0.58 () {64 vars in 1282 bytes} [Thu Jul 21 19:57:37 2022] POST /compute/v2.1/flavors => generated 408 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 19:57:37.537662 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi [None req-c26d1fe9-510c-4ffa-927d-2b3f92c2bdcc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 19:57:37.621071 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: INFO nova.api.openstack.requestlog [None req-c26d1fe9-510c-4ffa-927d-2b3f92c2bdcc admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.088868 Jul 21 19:57:37.622334 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: [pid: 103800|app: 0|req: 17/35] 10.222.0.58 () {64 vars in 1332 bytes} [Thu Jul 21 19:57:37 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 19:57:57.868004 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi [None req-bebad3ef-dab0-4ece-8a61-cdda1ed5a55a admin admin] Calling method '>' {{(pid=103801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 19:57:57.869034 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: INFO nova.api.openstack.requestlog [None req-bebad3ef-dab0-4ece-8a61-cdda1ed5a55a admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Jul 21 19:57:57.869431 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: [pid: 103801|app: 0|req: 19/36] 10.222.0.58 () {54 vars in 930 bytes} [Thu Jul 21 19:57:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 19:57:58.252844 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi [None req-3f193c4d-eaaa-47b8-bcf6-ad729b8b9924 admin admin] Calling method '>' {{(pid=103800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 19:57:58.270597 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: INFO nova.api.openstack.requestlog [None req-3f193c4d-eaaa-47b8-bcf6-ad729b8b9924 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.395294 Jul 21 19:57:58.271153 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: [pid: 103800|app: 0|req: 18/37] 10.222.0.58 () {60 vars in 1291 bytes} [Thu Jul 21 19:57:57 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 19:57:59.325173 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi [None req-bebad3ef-dab0-4ece-8a61-cdda1ed5a55a admin admin] Calling method '>' {{(pid=103801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 19:57:59.326178 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: INFO nova.api.openstack.requestlog [None req-bebad3ef-dab0-4ece-8a61-cdda1ed5a55a admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Jul 21 19:57:59.326582 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: [pid: 103801|app: 0|req: 20/38] 10.222.0.58 () {56 vars in 1074 bytes} [Thu Jul 21 19:57:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 19:57:59.851192 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi [None req-0c20f03a-72ae-461f-893d-deb2dc500390 admin admin] Calling method '>' {{(pid=103800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 19:57:59.856711 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: INFO nova.api.openstack.wsgi [None req-0c20f03a-72ae-461f-893d-deb2dc500390 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 21 19:57:59.860064 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi [None req-0c20f03a-72ae-461f-893d-deb2dc500390 admin admin] Request method failure captured: Jul 21 19:57:59.860064 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 21 19:57:59.860064 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: Accept: application/json Jul 21 19:57:59.860064 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: Accept-Encoding: gzip, deflate Jul 21 19:57:59.860064 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: Connection: keep-alive Jul 21 19:57:59.860064 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: Content-Length: 0 Jul 21 19:57:59.860064 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: Host: 10.222.0.58 Jul 21 19:57:59.860064 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: Openstack-Api-Version: compute 2.90 Jul 21 19:57:59.860064 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: Openstack-System-Scope: None Jul 21 19:57:59.860064 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: User-Agent: python-novaclient Jul 21 19:57:59.860064 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: X-Auth-Token: gAAAAABi2a_H0iPtkqTnsgtBzGK8N1UCeg-j8Augn-VpjthH-cqS46W6D2RearFJ6_HQ6gR5S5wULmDwQG8eQrAN8fLm2ggNl8fsELZzHouhpK1Sz3shcV4hAezIUHe3DnI0VFkwTGrHDx3ed93feYD1VE-66scffMMEpup4pX-k-qQWw0M4Wo8 Jul 21 19:57:59.860064 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: X-Domain-Id: None Jul 21 19:57:59.860064 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: X-Domain-Name: None Jul 21 19:57:59.860064 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: X-Identity-Status: Confirmed Jul 21 19:57:59.860064 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: X-Is-Admin-Project: True Jul 21 19:57:59.860064 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: X-Openstack-Nova-Api-Version: 2.90 Jul 21 19:57:59.860064 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: X-Project-Domain-Id: default Jul 21 19:57:59.860064 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: X-Project-Domain-Name: Default Jul 21 19:57:59.860064 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: X-Project-Id: 8caaf3b7410f425aa299a25acae892cd Jul 21 19:57:59.860064 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: X-Project-Name: admin Jul 21 19:57:59.860064 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: X-Role: reader,admin,member Jul 21 19:57:59.860064 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: X-Roles: reader,admin,member Jul 21 19:57:59.861738 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8caaf3b7410f425aa299a25acae892cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8caaf3b7410f425aa299a25acae892cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8caaf3b7410f425aa299a25acae892cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8caaf3b7410f425aa299a25acae892cd"}]}] Jul 21 19:57:59.861738 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: X-Tenant: admin Jul 21 19:57:59.861738 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: X-Tenant-Id: 8caaf3b7410f425aa299a25acae892cd Jul 21 19:57:59.861738 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: X-Tenant-Name: admin Jul 21 19:57:59.861738 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: X-User: admin Jul 21 19:57:59.861738 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: X-User-Domain-Id: default Jul 21 19:57:59.861738 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: X-User-Domain-Name: Default Jul 21 19:57:59.861738 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: X-User-Id: 1dcaf96438774a3892801861794529b5 Jul 21 19:57:59.861738 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: X-User-Name: admin Jul 21 19:57:59.861738 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: method: > Jul 21 19:57:59.861738 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: exception: Flavor 42 could not be found. Jul 21 19:57:59.861738 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: action_args: {'id': '42'} Jul 21 19:57:59.861738 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: {{(pid=103800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 19:57:59.861738 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 19:57:59.863517 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 21 19:57:59.863517 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 21 19:57:59.863517 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 21 19:57:59.863517 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 21 19:57:59.863517 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 21 19:57:59.863517 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 21 19:57:59.863517 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 21 19:57:59.863517 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 21 19:57:59.863517 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 21 19:57:59.863517 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 19:57:59.863517 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 21 19:57:59.863517 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 21 19:57:59.863517 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 21 19:57:59.863517 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi Jul 21 19:57:59.863517 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 19:57:59.863517 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi Jul 21 19:57:59.863517 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 19:57:59.863517 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 19:57:59.863517 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 19:57:59.864999 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 19:57:59.864999 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 19:57:59.864999 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 19:57:59.864999 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 19:57:59.864999 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 21 19:57:59.864999 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 21 19:57:59.864999 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 21 19:57:59.864999 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi Jul 21 19:57:59.864999 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 19:57:59.864999 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi Jul 21 19:57:59.864999 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 19:57:59.864999 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 19:57:59.864999 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 19:57:59.864999 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 19:57:59.864999 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 19:57:59.864999 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 21 19:57:59.864999 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi Jul 21 19:57:59.864999 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi [None req-0c20f03a-72ae-461f-893d-deb2dc500390 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 19:57:59.866262 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: INFO nova.api.openstack.requestlog [None req-0c20f03a-72ae-461f-893d-deb2dc500390 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.395259 Jul 21 19:57:59.866262 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: [pid: 103800|app: 0|req: 19/39] 10.222.0.58 () {60 vars in 1190 bytes} [Thu Jul 21 19:57:59 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 396 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 21 19:57:59.871932 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi [None req-8bad9624-bee0-4270-8a68-b71a5f5c3e12 admin admin] Calling method '>' {{(pid=103801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 19:57:59.874897 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG dbcounter [-] [103801] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:57:59.893236 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: INFO nova.api.openstack.requestlog [None req-8bad9624-bee0-4270-8a68-b71a5f5c3e12 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024963 Jul 21 19:57:59.893784 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: [pid: 103801|app: 0|req: 21/40] 10.222.0.58 () {60 vars in 1210 bytes} [Thu Jul 21 19:57:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 19:57:59.903463 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi [None req-aa84b139-7d69-4ea8-90f8-6efe3259969d admin admin] Calling method '>' {{(pid=103800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 19:57:59.924434 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: INFO nova.api.openstack.requestlog [None req-aa84b139-7d69-4ea8-90f8-6efe3259969d admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024580 Jul 21 19:57:59.925523 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: [pid: 103800|app: 0|req: 20/41] 10.222.0.58 () {60 vars in 1210 bytes} [Thu Jul 21 19:57:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 19:57:59.934955 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi [None req-6d3223eb-7a28-4da2-8e44-9f9ad23843bf admin admin] Calling method '>' {{(pid=103801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 19:57:59.940946 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: INFO nova.api.openstack.wsgi [None req-6d3223eb-7a28-4da2-8e44-9f9ad23843bf admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 21 19:57:59.944188 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi [None req-6d3223eb-7a28-4da2-8e44-9f9ad23843bf admin admin] Request method failure captured: Jul 21 19:57:59.944188 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 21 19:57:59.944188 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: Accept: application/json Jul 21 19:57:59.944188 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: Accept-Encoding: gzip, deflate Jul 21 19:57:59.944188 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: Connection: keep-alive Jul 21 19:57:59.944188 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: Content-Length: 0 Jul 21 19:57:59.944188 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: Host: 10.222.0.58 Jul 21 19:57:59.944188 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: Openstack-Api-Version: compute 2.90 Jul 21 19:57:59.944188 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: Openstack-System-Scope: None Jul 21 19:57:59.944188 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: User-Agent: python-novaclient Jul 21 19:57:59.944188 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: X-Auth-Token: gAAAAABi2a_H0iPtkqTnsgtBzGK8N1UCeg-j8Augn-VpjthH-cqS46W6D2RearFJ6_HQ6gR5S5wULmDwQG8eQrAN8fLm2ggNl8fsELZzHouhpK1Sz3shcV4hAezIUHe3DnI0VFkwTGrHDx3ed93feYD1VE-66scffMMEpup4pX-k-qQWw0M4Wo8 Jul 21 19:57:59.944188 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: X-Domain-Id: None Jul 21 19:57:59.944188 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: X-Domain-Name: None Jul 21 19:57:59.944188 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: X-Identity-Status: Confirmed Jul 21 19:57:59.944188 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: X-Is-Admin-Project: True Jul 21 19:57:59.944188 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: X-Openstack-Nova-Api-Version: 2.90 Jul 21 19:57:59.944188 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: X-Project-Domain-Id: default Jul 21 19:57:59.944188 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: X-Project-Domain-Name: Default Jul 21 19:57:59.944188 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: X-Project-Id: 8caaf3b7410f425aa299a25acae892cd Jul 21 19:57:59.944188 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: X-Project-Name: admin Jul 21 19:57:59.944188 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: X-Role: reader,admin,member Jul 21 19:57:59.944188 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: X-Roles: reader,admin,member Jul 21 19:57:59.945771 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8caaf3b7410f425aa299a25acae892cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8caaf3b7410f425aa299a25acae892cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8caaf3b7410f425aa299a25acae892cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8caaf3b7410f425aa299a25acae892cd"}]}] Jul 21 19:57:59.945771 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: X-Tenant: admin Jul 21 19:57:59.945771 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: X-Tenant-Id: 8caaf3b7410f425aa299a25acae892cd Jul 21 19:57:59.945771 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: X-Tenant-Name: admin Jul 21 19:57:59.945771 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: X-User: admin Jul 21 19:57:59.945771 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: X-User-Domain-Id: default Jul 21 19:57:59.945771 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: X-User-Domain-Name: Default Jul 21 19:57:59.945771 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: X-User-Id: 1dcaf96438774a3892801861794529b5 Jul 21 19:57:59.945771 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: X-User-Name: admin Jul 21 19:57:59.945771 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: method: > Jul 21 19:57:59.945771 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: exception: Flavor 42 could not be found. Jul 21 19:57:59.945771 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: action_args: {'id': '42'} Jul 21 19:57:59.945771 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: {{(pid=103801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 19:57:59.945771 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 19:57:59.946617 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 21 19:57:59.946617 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 21 19:57:59.946617 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 21 19:57:59.946617 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 21 19:57:59.946617 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 21 19:57:59.946617 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 21 19:57:59.946617 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 21 19:57:59.946617 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 21 19:57:59.946617 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 21 19:57:59.946617 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 19:57:59.946617 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 21 19:57:59.946617 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 21 19:57:59.946617 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 21 19:57:59.946617 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi Jul 21 19:57:59.946617 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 19:57:59.946617 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi Jul 21 19:57:59.946617 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 19:57:59.946617 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 19:57:59.946617 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 19:57:59.947887 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 19:57:59.947887 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 19:57:59.947887 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 19:57:59.947887 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 19:57:59.947887 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 21 19:57:59.947887 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 21 19:57:59.947887 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 21 19:57:59.947887 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi Jul 21 19:57:59.947887 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 19:57:59.947887 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi Jul 21 19:57:59.947887 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 19:57:59.947887 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 19:57:59.947887 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 19:57:59.947887 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 19:57:59.947887 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 19:57:59.947887 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 21 19:57:59.947887 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi Jul 21 19:57:59.947887 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi [None req-6d3223eb-7a28-4da2-8e44-9f9ad23843bf admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 19:57:59.949135 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: INFO nova.api.openstack.requestlog [None req-6d3223eb-7a28-4da2-8e44-9f9ad23843bf admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014434 Jul 21 19:57:59.949135 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: [pid: 103801|app: 0|req: 22/42] 10.222.0.58 () {60 vars in 1190 bytes} [Thu Jul 21 19:57:59 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 21 19:58:00.929001 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi [None req-aa84b139-7d69-4ea8-90f8-6efe3259969d admin admin] Calling method '>' {{(pid=103800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 19:58:00.930014 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: INFO nova.api.openstack.requestlog [None req-aa84b139-7d69-4ea8-90f8-6efe3259969d admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Jul 21 19:58:00.930411 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: [pid: 103800|app: 0|req: 21/43] 10.222.0.58 () {56 vars in 1074 bytes} [Thu Jul 21 19:58:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 19:58:01.454014 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi [None req-aed561b8-a6fb-45df-8512-f3f33799790a admin admin] Calling method '>' {{(pid=103801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 19:58:01.459282 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: INFO nova.api.openstack.wsgi [None req-aed561b8-a6fb-45df-8512-f3f33799790a admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 21 19:58:01.460773 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi [None req-aed561b8-a6fb-45df-8512-f3f33799790a admin admin] Request method failure captured: Jul 21 19:58:01.460773 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 21 19:58:01.460773 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: Accept: application/json Jul 21 19:58:01.460773 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: Accept-Encoding: gzip, deflate Jul 21 19:58:01.460773 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: Connection: keep-alive Jul 21 19:58:01.460773 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: Content-Length: 0 Jul 21 19:58:01.460773 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: Host: 10.222.0.58 Jul 21 19:58:01.460773 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: Openstack-Api-Version: compute 2.90 Jul 21 19:58:01.460773 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: Openstack-System-Scope: None Jul 21 19:58:01.460773 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: User-Agent: python-novaclient Jul 21 19:58:01.460773 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: X-Auth-Token: gAAAAABi2a_Ixt7ozt4jXxnGXbXEFaEoBdGWCbrLlDQRzkcV4BFuXsopKqKCFLXlYDKeL6gui2YOqtcDh93VRcM3l4Xn0Jv9EWM2PeK5idTHh8OfmMjxTpmNabjzW1k-GFrEVMNOe1iP8JYSTuKR_KyhLnCvmqnD0wLS8F_S_0ACkaZHcxH3B1U Jul 21 19:58:01.460773 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: X-Domain-Id: None Jul 21 19:58:01.460773 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: X-Domain-Name: None Jul 21 19:58:01.460773 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: X-Identity-Status: Confirmed Jul 21 19:58:01.460773 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: X-Is-Admin-Project: True Jul 21 19:58:01.460773 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: X-Openstack-Nova-Api-Version: 2.90 Jul 21 19:58:01.460773 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: X-Project-Domain-Id: default Jul 21 19:58:01.460773 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: X-Project-Domain-Name: Default Jul 21 19:58:01.460773 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: X-Project-Id: 8caaf3b7410f425aa299a25acae892cd Jul 21 19:58:01.460773 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: X-Project-Name: admin Jul 21 19:58:01.460773 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: X-Role: reader,admin,member Jul 21 19:58:01.460773 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: X-Roles: reader,admin,member Jul 21 19:58:01.462170 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8caaf3b7410f425aa299a25acae892cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8caaf3b7410f425aa299a25acae892cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8caaf3b7410f425aa299a25acae892cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8caaf3b7410f425aa299a25acae892cd"}]}] Jul 21 19:58:01.462170 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: X-Tenant: admin Jul 21 19:58:01.462170 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: X-Tenant-Id: 8caaf3b7410f425aa299a25acae892cd Jul 21 19:58:01.462170 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: X-Tenant-Name: admin Jul 21 19:58:01.462170 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: X-User: admin Jul 21 19:58:01.462170 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: X-User-Domain-Id: default Jul 21 19:58:01.462170 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: X-User-Domain-Name: Default Jul 21 19:58:01.462170 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: X-User-Id: 1dcaf96438774a3892801861794529b5 Jul 21 19:58:01.462170 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: X-User-Name: admin Jul 21 19:58:01.462170 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: method: > Jul 21 19:58:01.462170 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: exception: Flavor 84 could not be found. Jul 21 19:58:01.462170 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: action_args: {'id': '84'} Jul 21 19:58:01.462170 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: {{(pid=103801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 19:58:01.462170 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 19:58:01.462969 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 21 19:58:01.462969 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 21 19:58:01.462969 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 21 19:58:01.462969 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 21 19:58:01.462969 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 21 19:58:01.462969 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 21 19:58:01.462969 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 21 19:58:01.462969 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 21 19:58:01.462969 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 21 19:58:01.462969 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 19:58:01.462969 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 21 19:58:01.462969 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 21 19:58:01.462969 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 21 19:58:01.462969 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi Jul 21 19:58:01.462969 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 19:58:01.462969 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi Jul 21 19:58:01.462969 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 19:58:01.462969 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 19:58:01.462969 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 19:58:01.464301 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 19:58:01.464301 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 19:58:01.464301 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 19:58:01.464301 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 19:58:01.464301 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 21 19:58:01.464301 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 21 19:58:01.464301 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 21 19:58:01.464301 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi Jul 21 19:58:01.464301 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 19:58:01.464301 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi Jul 21 19:58:01.464301 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 19:58:01.464301 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 19:58:01.464301 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 19:58:01.464301 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 19:58:01.464301 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 19:58:01.464301 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 21 19:58:01.464301 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi Jul 21 19:58:01.464301 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi [None req-aed561b8-a6fb-45df-8512-f3f33799790a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 19:58:01.465530 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: INFO nova.api.openstack.requestlog [None req-aed561b8-a6fb-45df-8512-f3f33799790a admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.391687 Jul 21 19:58:01.465530 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: [pid: 103801|app: 0|req: 23/44] 10.222.0.58 () {60 vars in 1190 bytes} [Thu Jul 21 19:58:01 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 393 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 21 19:58:01.476455 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi [None req-803dc54a-243d-4281-8ed8-d092dbe82b75 admin admin] Calling method '>' {{(pid=103800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 19:58:01.491796 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: INFO nova.api.openstack.requestlog [None req-803dc54a-243d-4281-8ed8-d092dbe82b75 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023620 Jul 21 19:58:01.492345 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: [pid: 103800|app: 0|req: 22/45] 10.222.0.58 () {60 vars in 1210 bytes} [Thu Jul 21 19:58:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 19:58:01.501809 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi [None req-32174834-dfbe-4e42-a925-0eda44485c8f admin admin] Calling method '>' {{(pid=103801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 19:58:01.515314 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: INFO nova.api.openstack.requestlog [None req-32174834-dfbe-4e42-a925-0eda44485c8f admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017015 Jul 21 19:58:01.515824 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: [pid: 103801|app: 0|req: 24/46] 10.222.0.58 () {60 vars in 1210 bytes} [Thu Jul 21 19:58:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 19:58:01.524751 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi [None req-467fef36-7d6b-4580-ab19-0dddc477d8d5 admin admin] Calling method '>' {{(pid=103800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 19:58:01.529999 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: INFO nova.api.openstack.wsgi [None req-467fef36-7d6b-4580-ab19-0dddc477d8d5 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 21 19:58:01.531533 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi [None req-467fef36-7d6b-4580-ab19-0dddc477d8d5 admin admin] Request method failure captured: Jul 21 19:58:01.531533 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 21 19:58:01.531533 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: Accept: application/json Jul 21 19:58:01.531533 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: Accept-Encoding: gzip, deflate Jul 21 19:58:01.531533 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: Connection: keep-alive Jul 21 19:58:01.531533 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: Content-Length: 0 Jul 21 19:58:01.531533 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: Host: 10.222.0.58 Jul 21 19:58:01.531533 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: Openstack-Api-Version: compute 2.90 Jul 21 19:58:01.531533 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: Openstack-System-Scope: None Jul 21 19:58:01.531533 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: User-Agent: python-novaclient Jul 21 19:58:01.531533 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: X-Auth-Token: gAAAAABi2a_Ixt7ozt4jXxnGXbXEFaEoBdGWCbrLlDQRzkcV4BFuXsopKqKCFLXlYDKeL6gui2YOqtcDh93VRcM3l4Xn0Jv9EWM2PeK5idTHh8OfmMjxTpmNabjzW1k-GFrEVMNOe1iP8JYSTuKR_KyhLnCvmqnD0wLS8F_S_0ACkaZHcxH3B1U Jul 21 19:58:01.531533 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: X-Domain-Id: None Jul 21 19:58:01.531533 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: X-Domain-Name: None Jul 21 19:58:01.531533 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: X-Identity-Status: Confirmed Jul 21 19:58:01.531533 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: X-Is-Admin-Project: True Jul 21 19:58:01.531533 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: X-Openstack-Nova-Api-Version: 2.90 Jul 21 19:58:01.531533 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: X-Project-Domain-Id: default Jul 21 19:58:01.531533 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: X-Project-Domain-Name: Default Jul 21 19:58:01.531533 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: X-Project-Id: 8caaf3b7410f425aa299a25acae892cd Jul 21 19:58:01.531533 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: X-Project-Name: admin Jul 21 19:58:01.531533 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: X-Role: reader,admin,member Jul 21 19:58:01.531533 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: X-Roles: reader,admin,member Jul 21 19:58:01.532974 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8caaf3b7410f425aa299a25acae892cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8caaf3b7410f425aa299a25acae892cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8caaf3b7410f425aa299a25acae892cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8caaf3b7410f425aa299a25acae892cd"}]}] Jul 21 19:58:01.532974 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: X-Tenant: admin Jul 21 19:58:01.532974 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: X-Tenant-Id: 8caaf3b7410f425aa299a25acae892cd Jul 21 19:58:01.532974 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: X-Tenant-Name: admin Jul 21 19:58:01.532974 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: X-User: admin Jul 21 19:58:01.532974 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: X-User-Domain-Id: default Jul 21 19:58:01.532974 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: X-User-Domain-Name: Default Jul 21 19:58:01.532974 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: X-User-Id: 1dcaf96438774a3892801861794529b5 Jul 21 19:58:01.532974 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: X-User-Name: admin Jul 21 19:58:01.532974 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: method: > Jul 21 19:58:01.532974 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: exception: Flavor 84 could not be found. Jul 21 19:58:01.532974 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: action_args: {'id': '84'} Jul 21 19:58:01.532974 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: {{(pid=103800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 19:58:01.532974 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 19:58:01.533904 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 21 19:58:01.533904 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 21 19:58:01.533904 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 21 19:58:01.533904 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 21 19:58:01.533904 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 21 19:58:01.533904 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 21 19:58:01.533904 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 21 19:58:01.533904 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 21 19:58:01.533904 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 21 19:58:01.533904 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 19:58:01.533904 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 21 19:58:01.533904 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 21 19:58:01.533904 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 21 19:58:01.533904 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi Jul 21 19:58:01.533904 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 19:58:01.533904 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi Jul 21 19:58:01.533904 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 19:58:01.533904 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 19:58:01.533904 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 19:58:01.535706 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 19:58:01.535706 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 19:58:01.535706 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 19:58:01.535706 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 19:58:01.535706 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 21 19:58:01.535706 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 21 19:58:01.535706 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 21 19:58:01.535706 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi Jul 21 19:58:01.535706 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 19:58:01.535706 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi Jul 21 19:58:01.535706 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 19:58:01.535706 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 19:58:01.535706 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 19:58:01.535706 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 19:58:01.535706 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 19:58:01.535706 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 21 19:58:01.535706 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi Jul 21 19:58:01.535706 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi [None req-467fef36-7d6b-4580-ab19-0dddc477d8d5 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 19:58:01.536882 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: INFO nova.api.openstack.requestlog [None req-467fef36-7d6b-4580-ab19-0dddc477d8d5 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011590 Jul 21 19:58:01.536882 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: [pid: 103800|app: 0|req: 23/47] 10.222.0.58 () {60 vars in 1190 bytes} [Thu Jul 21 19:58:01 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 21 19:58:02.501260 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi [None req-32174834-dfbe-4e42-a925-0eda44485c8f admin admin] Calling method '>' {{(pid=103801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 19:58:02.502253 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: INFO nova.api.openstack.requestlog [None req-32174834-dfbe-4e42-a925-0eda44485c8f admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 Jul 21 19:58:02.502640 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: [pid: 103801|app: 0|req: 25/48] 10.222.0.58 () {56 vars in 1074 bytes} [Thu Jul 21 19:58:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 19:58:03.019965 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi [None req-6f04bd41-739f-44ac-ad60-3d6fdd047539 admin admin] Calling method '>' {{(pid=103800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 19:58:03.025695 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: INFO nova.api.openstack.wsgi [None req-6f04bd41-739f-44ac-ad60-3d6fdd047539 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 21 19:58:03.027223 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi [None req-6f04bd41-739f-44ac-ad60-3d6fdd047539 admin admin] Request method failure captured: Jul 21 19:58:03.027223 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 21 19:58:03.027223 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: Accept: application/json Jul 21 19:58:03.027223 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: Accept-Encoding: gzip, deflate Jul 21 19:58:03.027223 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: Connection: keep-alive Jul 21 19:58:03.027223 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: Content-Length: 0 Jul 21 19:58:03.027223 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: Host: 10.222.0.58 Jul 21 19:58:03.027223 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: Openstack-Api-Version: compute 2.90 Jul 21 19:58:03.027223 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: Openstack-System-Scope: None Jul 21 19:58:03.027223 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: User-Agent: python-novaclient Jul 21 19:58:03.027223 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: X-Auth-Token: gAAAAABi2a_KeyGYddNu1JDZ11gXEPH2H9ImW3QslDMjXb7LlxTFfsfRNV3sCxsMm4CA7i2XDOzXsoGWdLAPQuQcfyDg1GGsrTsbEHJ8sdD_TLLnxAL0Q-XrqenT-U9fWJsfRQOIQNR1Jf8say9jRp4XbV5PrQBdkpsLntIcL3nyQ5_jrbpA_AY Jul 21 19:58:03.027223 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: X-Domain-Id: None Jul 21 19:58:03.027223 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: X-Domain-Name: None Jul 21 19:58:03.027223 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: X-Identity-Status: Confirmed Jul 21 19:58:03.027223 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: X-Is-Admin-Project: True Jul 21 19:58:03.027223 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: X-Openstack-Nova-Api-Version: 2.90 Jul 21 19:58:03.027223 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: X-Project-Domain-Id: default Jul 21 19:58:03.027223 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: X-Project-Domain-Name: Default Jul 21 19:58:03.027223 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: X-Project-Id: 8caaf3b7410f425aa299a25acae892cd Jul 21 19:58:03.027223 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: X-Project-Name: admin Jul 21 19:58:03.027223 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: X-Role: reader,admin,member Jul 21 19:58:03.027223 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: X-Roles: reader,admin,member Jul 21 19:58:03.028768 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8caaf3b7410f425aa299a25acae892cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8caaf3b7410f425aa299a25acae892cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8caaf3b7410f425aa299a25acae892cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8caaf3b7410f425aa299a25acae892cd"}]}] Jul 21 19:58:03.028768 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: X-Tenant: admin Jul 21 19:58:03.028768 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: X-Tenant-Id: 8caaf3b7410f425aa299a25acae892cd Jul 21 19:58:03.028768 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: X-Tenant-Name: admin Jul 21 19:58:03.028768 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: X-User: admin Jul 21 19:58:03.028768 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: X-User-Domain-Id: default Jul 21 19:58:03.028768 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: X-User-Domain-Name: Default Jul 21 19:58:03.028768 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: X-User-Id: 1dcaf96438774a3892801861794529b5 Jul 21 19:58:03.028768 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: X-User-Name: admin Jul 21 19:58:03.028768 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: method: > Jul 21 19:58:03.028768 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: exception: Flavor 451 could not be found. Jul 21 19:58:03.028768 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: action_args: {'id': '451'} Jul 21 19:58:03.028768 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: {{(pid=103800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 19:58:03.028768 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 19:58:03.029610 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 21 19:58:03.029610 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 21 19:58:03.029610 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 21 19:58:03.029610 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 21 19:58:03.029610 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 21 19:58:03.029610 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 21 19:58:03.029610 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 21 19:58:03.029610 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 21 19:58:03.029610 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 21 19:58:03.029610 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 19:58:03.029610 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 21 19:58:03.029610 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 21 19:58:03.029610 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 21 19:58:03.029610 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi Jul 21 19:58:03.029610 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 19:58:03.029610 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi Jul 21 19:58:03.029610 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 19:58:03.029610 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 19:58:03.029610 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 19:58:03.030715 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 19:58:03.030715 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 19:58:03.030715 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 19:58:03.030715 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 19:58:03.030715 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 21 19:58:03.030715 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 21 19:58:03.030715 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 21 19:58:03.030715 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi Jul 21 19:58:03.030715 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 19:58:03.030715 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi Jul 21 19:58:03.030715 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 19:58:03.030715 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 19:58:03.030715 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 19:58:03.030715 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 19:58:03.030715 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 19:58:03.030715 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 21 19:58:03.030715 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi Jul 21 19:58:03.030715 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi [None req-6f04bd41-739f-44ac-ad60-3d6fdd047539 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 19:58:03.031971 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: INFO nova.api.openstack.requestlog [None req-6f04bd41-739f-44ac-ad60-3d6fdd047539 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.388081 Jul 21 19:58:03.031971 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: [pid: 103800|app: 0|req: 24/49] 10.222.0.58 () {60 vars in 1193 bytes} [Thu Jul 21 19:58:02 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 389 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 21 19:58:03.039011 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi [None req-290831be-d989-483b-82d0-aa3532e8a760 admin admin] Calling method '>' {{(pid=103801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 19:58:03.052963 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: INFO nova.api.openstack.requestlog [None req-290831be-d989-483b-82d0-aa3532e8a760 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017804 Jul 21 19:58:03.053478 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: [pid: 103801|app: 0|req: 26/50] 10.222.0.58 () {60 vars in 1210 bytes} [Thu Jul 21 19:58:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 19:58:03.062740 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi [None req-ae543225-7ce7-4119-8379-770be3864a0f admin admin] Calling method '>' {{(pid=103800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 19:58:03.077297 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: INFO nova.api.openstack.requestlog [None req-ae543225-7ce7-4119-8379-770be3864a0f admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018007 Jul 21 19:58:03.077823 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: [pid: 103800|app: 0|req: 25/51] 10.222.0.58 () {60 vars in 1210 bytes} [Thu Jul 21 19:58:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 19:58:03.087152 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi [None req-6967874c-4a78-43cc-a329-56b6a47af270 admin admin] Calling method '>' {{(pid=103801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 19:58:03.092355 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: INFO nova.api.openstack.wsgi [None req-6967874c-4a78-43cc-a329-56b6a47af270 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 21 19:58:03.093819 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi [None req-6967874c-4a78-43cc-a329-56b6a47af270 admin admin] Request method failure captured: Jul 21 19:58:03.093819 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 21 19:58:03.093819 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: Accept: application/json Jul 21 19:58:03.093819 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: Accept-Encoding: gzip, deflate Jul 21 19:58:03.093819 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: Connection: keep-alive Jul 21 19:58:03.093819 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: Content-Length: 0 Jul 21 19:58:03.093819 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: Host: 10.222.0.58 Jul 21 19:58:03.093819 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: Openstack-Api-Version: compute 2.90 Jul 21 19:58:03.093819 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: Openstack-System-Scope: None Jul 21 19:58:03.093819 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: User-Agent: python-novaclient Jul 21 19:58:03.093819 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: X-Auth-Token: gAAAAABi2a_KeyGYddNu1JDZ11gXEPH2H9ImW3QslDMjXb7LlxTFfsfRNV3sCxsMm4CA7i2XDOzXsoGWdLAPQuQcfyDg1GGsrTsbEHJ8sdD_TLLnxAL0Q-XrqenT-U9fWJsfRQOIQNR1Jf8say9jRp4XbV5PrQBdkpsLntIcL3nyQ5_jrbpA_AY Jul 21 19:58:03.093819 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: X-Domain-Id: None Jul 21 19:58:03.093819 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: X-Domain-Name: None Jul 21 19:58:03.093819 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: X-Identity-Status: Confirmed Jul 21 19:58:03.093819 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: X-Is-Admin-Project: True Jul 21 19:58:03.093819 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: X-Openstack-Nova-Api-Version: 2.90 Jul 21 19:58:03.093819 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: X-Project-Domain-Id: default Jul 21 19:58:03.093819 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: X-Project-Domain-Name: Default Jul 21 19:58:03.093819 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: X-Project-Id: 8caaf3b7410f425aa299a25acae892cd Jul 21 19:58:03.093819 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: X-Project-Name: admin Jul 21 19:58:03.093819 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: X-Role: reader,admin,member Jul 21 19:58:03.093819 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: X-Roles: reader,admin,member Jul 21 19:58:03.095544 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8caaf3b7410f425aa299a25acae892cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8caaf3b7410f425aa299a25acae892cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8caaf3b7410f425aa299a25acae892cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8caaf3b7410f425aa299a25acae892cd"}]}] Jul 21 19:58:03.095544 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: X-Tenant: admin Jul 21 19:58:03.095544 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: X-Tenant-Id: 8caaf3b7410f425aa299a25acae892cd Jul 21 19:58:03.095544 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: X-Tenant-Name: admin Jul 21 19:58:03.095544 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: X-User: admin Jul 21 19:58:03.095544 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: X-User-Domain-Id: default Jul 21 19:58:03.095544 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: X-User-Domain-Name: Default Jul 21 19:58:03.095544 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: X-User-Id: 1dcaf96438774a3892801861794529b5 Jul 21 19:58:03.095544 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: X-User-Name: admin Jul 21 19:58:03.095544 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: method: > Jul 21 19:58:03.095544 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: exception: Flavor 451 could not be found. Jul 21 19:58:03.095544 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: action_args: {'id': '451'} Jul 21 19:58:03.095544 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: {{(pid=103801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 19:58:03.095544 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 19:58:03.096310 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 21 19:58:03.096310 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 21 19:58:03.096310 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 21 19:58:03.096310 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 21 19:58:03.096310 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 21 19:58:03.096310 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 21 19:58:03.096310 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 21 19:58:03.096310 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 21 19:58:03.096310 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 21 19:58:03.096310 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 19:58:03.096310 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 21 19:58:03.096310 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 21 19:58:03.096310 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 21 19:58:03.096310 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi Jul 21 19:58:03.096310 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 19:58:03.096310 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi Jul 21 19:58:03.096310 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 19:58:03.096310 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 19:58:03.096310 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 19:58:03.097850 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 19:58:03.097850 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 19:58:03.097850 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 19:58:03.097850 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 19:58:03.097850 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 21 19:58:03.097850 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 21 19:58:03.097850 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 21 19:58:03.097850 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi Jul 21 19:58:03.097850 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 19:58:03.097850 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi Jul 21 19:58:03.097850 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 19:58:03.097850 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 19:58:03.097850 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 19:58:03.097850 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 19:58:03.097850 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 19:58:03.097850 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 21 19:58:03.097850 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi Jul 21 19:58:03.097850 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi [None req-6967874c-4a78-43cc-a329-56b6a47af270 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 19:58:03.098872 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: INFO nova.api.openstack.requestlog [None req-6967874c-4a78-43cc-a329-56b6a47af270 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011834 Jul 21 19:58:03.098872 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: [pid: 103801|app: 0|req: 27/52] 10.222.0.58 () {60 vars in 1193 bytes} [Thu Jul 21 19:58:03 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 21 19:58:04.065874 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi [None req-ae543225-7ce7-4119-8379-770be3864a0f admin admin] Calling method '>' {{(pid=103800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 19:58:04.066890 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: INFO nova.api.openstack.requestlog [None req-ae543225-7ce7-4119-8379-770be3864a0f admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Jul 21 19:58:04.067313 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: [pid: 103800|app: 0|req: 26/53] 10.222.0.58 () {56 vars in 1074 bytes} [Thu Jul 21 19:58:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 19:58:04.596091 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi [None req-6465309c-1661-4b88-bbb2-e37ed37af26f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 19:58:04.687197 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: INFO nova.api.openstack.requestlog [None req-6465309c-1661-4b88-bbb2-e37ed37af26f admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.482032 Jul 21 19:58:04.694448 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: [pid: 103801|app: 0|req: 28/54] 10.222.0.58 () {64 vars in 1235 bytes} [Thu Jul 21 19:58:04 2022] POST /compute/v2.1/flavors => generated 404 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 19:58:05.660947 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi [None req-ae543225-7ce7-4119-8379-770be3864a0f admin admin] Calling method '>' {{(pid=103800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 19:58:05.661950 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: INFO nova.api.openstack.requestlog [None req-ae543225-7ce7-4119-8379-770be3864a0f admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Jul 21 19:58:05.662379 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: [pid: 103800|app: 0|req: 27/55] 10.222.0.58 () {56 vars in 1074 bytes} [Thu Jul 21 19:58:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 19:58:06.180179 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi [None req-76301804-08ac-46cd-88b3-87d0a73296eb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 19:58:06.292752 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: INFO nova.api.openstack.requestlog [None req-76301804-08ac-46cd-88b3-87d0a73296eb admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.492009 Jul 21 19:58:06.293302 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: [pid: 103801|app: 0|req: 29/56] 10.222.0.58 () {64 vars in 1235 bytes} [Thu Jul 21 19:58:05 2022] POST /compute/v2.1/flavors => generated 405 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 19:58:07.276232 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi [None req-ae543225-7ce7-4119-8379-770be3864a0f admin admin] Calling method '>' {{(pid=103800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 19:58:07.277236 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: INFO nova.api.openstack.requestlog [None req-ae543225-7ce7-4119-8379-770be3864a0f admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Jul 21 19:58:07.277624 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: [pid: 103800|app: 0|req: 28/57] 10.222.0.58 () {56 vars in 1074 bytes} [Thu Jul 21 19:58:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 19:58:07.815310 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi [None req-56519783-62ee-488a-87a3-dce889be50da admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 19:58:07.922014 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: INFO nova.api.openstack.requestlog [None req-56519783-62ee-488a-87a3-dce889be50da admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.505101 Jul 21 19:58:07.922511 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: [pid: 103801|app: 0|req: 30/58] 10.222.0.58 () {64 vars in 1235 bytes} [Thu Jul 21 19:58:07 2022] POST /compute/v2.1/flavors => generated 407 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 19:58:08.883807 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi [None req-ae543225-7ce7-4119-8379-770be3864a0f admin admin] Calling method '>' {{(pid=103800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 19:58:08.884825 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: INFO nova.api.openstack.requestlog [None req-ae543225-7ce7-4119-8379-770be3864a0f admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Jul 21 19:58:08.885225 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: [pid: 103800|app: 0|req: 29/59] 10.222.0.58 () {56 vars in 1074 bytes} [Thu Jul 21 19:58:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 19:58:09.403417 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi [None req-3c9dbb06-b08f-4643-9e7d-42e8a23a8421 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 19:58:09.506638 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: INFO nova.api.openstack.requestlog [None req-3c9dbb06-b08f-4643-9e7d-42e8a23a8421 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.484070 Jul 21 19:58:09.507198 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: [pid: 103801|app: 0|req: 31/60] 10.222.0.58 () {64 vars in 1235 bytes} [Thu Jul 21 19:58:09 2022] POST /compute/v2.1/flavors => generated 409 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 19:58:10.469294 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi [None req-ae543225-7ce7-4119-8379-770be3864a0f admin admin] Calling method '>' {{(pid=103800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 19:58:10.470593 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: INFO nova.api.openstack.requestlog [None req-ae543225-7ce7-4119-8379-770be3864a0f admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001722 Jul 21 19:58:10.470994 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: [pid: 103800|app: 0|req: 30/61] 10.222.0.58 () {56 vars in 1074 bytes} [Thu Jul 21 19:58:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 19:58:10.990174 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi [None req-326a84e8-0624-4cb6-997c-56032845eb0e admin admin] Calling method '>' {{(pid=103801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 19:58:11.009422 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: INFO nova.api.openstack.requestlog [None req-326a84e8-0624-4cb6-997c-56032845eb0e admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.402184 Jul 21 19:58:11.009960 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: [pid: 103801|app: 0|req: 32/62] 10.222.0.58 () {60 vars in 1202 bytes} [Thu Jul 21 19:58:10 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 19:59:02.722343 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi [None req-ae543225-7ce7-4119-8379-770be3864a0f admin admin] Calling method '>' {{(pid=103800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 19:59:02.723367 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: INFO nova.api.openstack.requestlog [None req-ae543225-7ce7-4119-8379-770be3864a0f admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Jul 21 19:59:02.723762 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: [pid: 103800|app: 0|req: 31/63] 10.222.0.58 () {54 vars in 930 bytes} [Thu Jul 21 19:59:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 19:59:02.733954 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG dbcounter [-] [103801] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:59:03.114194 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi [None req-a8e74c27-2697-4238-b3c9-0b7a0bb5b6dd admin admin] Calling method '>' {{(pid=103801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 19:59:03.132828 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: INFO nova.api.openstack.requestlog [None req-a8e74c27-2697-4238-b3c9-0b7a0bb5b6dd admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.403435 Jul 21 19:59:03.133441 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: [pid: 103801|app: 0|req: 33/64] 10.222.0.58 () {60 vars in 1291 bytes} [Thu Jul 21 19:59:02 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 19:59:03.154884 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG dbcounter [-] [103800] Writing DB stats nova_api:SELECT=21,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:59:03.159275 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi [None req-7e4a4813-c498-4a02-b369-277fa7fb5529 admin admin] Calling method '>' {{(pid=103800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 19:59:03.166618 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: INFO nova.api.openstack.requestlog [None req-7e4a4813-c498-4a02-b369-277fa7fb5529 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013146 Jul 21 19:59:03.167199 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: [pid: 103800|app: 0|req: 32/65] 10.222.0.58 () {60 vars in 1282 bytes} [Thu Jul 21 19:59:03 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 19:59:03.178704 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi [None req-3eeea696-3149-4f8b-a591-d06eb310571e admin admin] Calling method '>' {{(pid=103801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 19:59:03.186358 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: INFO nova.api.openstack.requestlog [None req-3eeea696-3149-4f8b-a591-d06eb310571e admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011216 Jul 21 19:59:03.186864 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: [pid: 103801|app: 0|req: 34/66] 10.222.0.58 () {60 vars in 1285 bytes} [Thu Jul 21 19:59:03 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 19:59:03.197965 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi [None req-5a2f1541-eab2-4fa1-9a02-4edfdd7ff7b2 admin admin] Calling method '>' {{(pid=103800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 19:59:03.206260 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: INFO nova.api.openstack.requestlog [None req-5a2f1541-eab2-4fa1-9a02-4edfdd7ff7b2 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011756 Jul 21 19:59:03.206775 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: [pid: 103800|app: 0|req: 33/67] 10.222.0.58 () {60 vars in 1285 bytes} [Thu Jul 21 19:59:03 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 19:59:03.217673 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi [None req-e295f338-8eb2-4832-8111-9e40bcca1f6e admin admin] Calling method '>' {{(pid=103801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 19:59:03.225955 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: INFO nova.api.openstack.requestlog [None req-e295f338-8eb2-4832-8111-9e40bcca1f6e admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011729 Jul 21 19:59:03.226459 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: [pid: 103801|app: 0|req: 35/68] 10.222.0.58 () {60 vars in 1282 bytes} [Thu Jul 21 19:59:03 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:02:39.342914 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi [None req-5a2f1541-eab2-4fa1-9a02-4edfdd7ff7b2 admin admin] Calling method '>' {{(pid=103800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:02:39.345632 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: INFO nova.api.openstack.requestlog [None req-5a2f1541-eab2-4fa1-9a02-4edfdd7ff7b2 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001771 Jul 21 20:02:39.345632 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: [pid: 103800|app: 0|req: 34/69] 10.222.0.58 () {56 vars in 1074 bytes} [Thu Jul 21 20:02:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:02:39.489784 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG dbcounter [-] [103801] Writing DB stats nova_api:SELECT=6 {{(pid=103801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:02:39.658113 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi [None req-c9176ff8-89f5-4f3c-8c07-d57407a00cfe admin admin] Calling method '>' {{(pid=103801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:02:39.659460 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 20:02:39.659460 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: warnings.warn(msg) Jul 21 20:02:39.660815 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG oslo_concurrency.lockutils [None req-c9176ff8-89f5-4f3c-8c07-d57407a00cfe admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:02:39.661229 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG oslo_concurrency.lockutils [None req-c9176ff8-89f5-4f3c-8c07-d57407a00cfe admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:02:39.662030 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG oslo_concurrency.lockutils [None req-c9176ff8-89f5-4f3c-8c07-d57407a00cfe admin admin] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:02:39.662453 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG oslo_concurrency.lockutils [None req-c9176ff8-89f5-4f3c-8c07-d57407a00cfe admin admin] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:02:39.696277 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: INFO nova.api.openstack.requestlog [None req-c9176ff8-89f5-4f3c-8c07-d57407a00cfe admin admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.211657 Jul 21 20:02:39.696849 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: [pid: 103801|app: 0|req: 36/70] 10.222.0.58 () {60 vars in 1193 bytes} [Thu Jul 21 20:02:39 2022] GET /compute/v2.1/os-services => generated 791 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 20:02:40.528208 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi [None req-5a2f1541-eab2-4fa1-9a02-4edfdd7ff7b2 admin admin] Calling method '>' {{(pid=103800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:02:40.529288 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: INFO nova.api.openstack.requestlog [None req-5a2f1541-eab2-4fa1-9a02-4edfdd7ff7b2 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Jul 21 20:02:40.529818 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: [pid: 103800|app: 0|req: 35/71] 10.222.0.58 () {56 vars in 1074 bytes} [Thu Jul 21 20:02:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:02:40.726027 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi [None req-2fe0aab3-6002-4422-a5d7-8fd6ae30dd7b admin admin] Calling method '>' {{(pid=103801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:02:40.727220 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 20:02:40.727220 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: warnings.warn(msg) Jul 21 20:02:40.728954 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG oslo_concurrency.lockutils [None req-2fe0aab3-6002-4422-a5d7-8fd6ae30dd7b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:02:40.729396 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG oslo_concurrency.lockutils [None req-2fe0aab3-6002-4422-a5d7-8fd6ae30dd7b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:02:40.730230 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG oslo_concurrency.lockutils [None req-2fe0aab3-6002-4422-a5d7-8fd6ae30dd7b admin admin] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:02:40.730658 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG oslo_concurrency.lockutils [None req-2fe0aab3-6002-4422-a5d7-8fd6ae30dd7b admin admin] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:02:40.750478 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: INFO nova.api.openstack.requestlog [None req-2fe0aab3-6002-4422-a5d7-8fd6ae30dd7b admin admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.076361 Jul 21 20:02:40.751044 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: [pid: 103801|app: 0|req: 37/72] 10.222.0.58 () {60 vars in 1193 bytes} [Thu Jul 21 20:02:40 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 20:02:51.989366 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi [None req-5a2f1541-eab2-4fa1-9a02-4edfdd7ff7b2 admin admin] Calling method '>' {{(pid=103800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:02:51.990381 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: INFO nova.api.openstack.requestlog [None req-5a2f1541-eab2-4fa1-9a02-4edfdd7ff7b2 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Jul 21 20:02:51.990779 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: [pid: 103800|app: 0|req: 36/73] 10.222.0.58 () {56 vars in 1074 bytes} [Thu Jul 21 20:02:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:02:52.130829 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG dbcounter [-] [103801] Writing DB stats nova_cell0:SELECT=4 {{(pid=103801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:02:52.131588 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG dbcounter [-] [103801] Writing DB stats nova_cell1:SELECT=4 {{(pid=103801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:02:52.132211 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG dbcounter [-] [103801] Writing DB stats nova_api:SELECT=8 {{(pid=103801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:02:52.182223 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi [None req-d6b22ef7-809b-46c8-aa0a-0eb5f25964dd admin admin] Calling method '>' {{(pid=103801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:02:52.183420 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 20:02:52.183420 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: warnings.warn(msg) Jul 21 20:02:52.184608 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG oslo_concurrency.lockutils [None req-d6b22ef7-809b-46c8-aa0a-0eb5f25964dd admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:02:52.185054 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG oslo_concurrency.lockutils [None req-d6b22ef7-809b-46c8-aa0a-0eb5f25964dd admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:02:52.185844 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG oslo_concurrency.lockutils [None req-d6b22ef7-809b-46c8-aa0a-0eb5f25964dd admin admin] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:02:52.186274 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG oslo_concurrency.lockutils [None req-d6b22ef7-809b-46c8-aa0a-0eb5f25964dd admin admin] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:02:52.211544 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: INFO nova.api.openstack.requestlog [None req-d6b22ef7-809b-46c8-aa0a-0eb5f25964dd admin admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.085102 Jul 21 20:02:52.212033 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: [pid: 103801|app: 0|req: 38/74] 10.222.0.58 () {60 vars in 1193 bytes} [Thu Jul 21 20:02:52 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:02:53.036523 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi [None req-5a2f1541-eab2-4fa1-9a02-4edfdd7ff7b2 admin admin] Calling method '>' {{(pid=103800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:02:53.037526 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: INFO nova.api.openstack.requestlog [None req-5a2f1541-eab2-4fa1-9a02-4edfdd7ff7b2 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Jul 21 20:02:53.037922 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: [pid: 103800|app: 0|req: 37/75] 10.222.0.58 () {56 vars in 1074 bytes} [Thu Jul 21 20:02:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:02:53.228204 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi [None req-4a0a4afd-bd16-48be-a642-73836511fc3e admin admin] Calling method '>' {{(pid=103801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:02:53.229396 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 20:02:53.229396 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: warnings.warn(msg) Jul 21 20:02:53.230599 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG oslo_concurrency.lockutils [None req-4a0a4afd-bd16-48be-a642-73836511fc3e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:02:53.231068 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG oslo_concurrency.lockutils [None req-4a0a4afd-bd16-48be-a642-73836511fc3e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:02:53.231864 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG oslo_concurrency.lockutils [None req-4a0a4afd-bd16-48be-a642-73836511fc3e admin admin] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:02:53.232323 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: DEBUG oslo_concurrency.lockutils [None req-4a0a4afd-bd16-48be-a642-73836511fc3e admin admin] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:02:53.253860 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: INFO nova.api.openstack.requestlog [None req-4a0a4afd-bd16-48be-a642-73836511fc3e admin admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.077283 Jul 21 20:02:53.254339 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: [pid: 103801|app: 0|req: 39/76] 10.222.0.58 () {60 vars in 1193 bytes} [Thu Jul 21 20:02:53 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:03:51.787797 dv-cinder-850548-2-iscsi devstack@n-api.service[103799]: Thu Jul 21 20:03:51 2022 - graceful shutdown triggered... Jul 21 20:03:51.787841 dv-cinder-850548-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 21 20:03:51.788891 dv-cinder-850548-2-iscsi devstack@n-api.service[103800]: Gracefully killing worker 1 (pid: 103800)... Jul 21 20:03:51.789781 dv-cinder-850548-2-iscsi devstack@n-api.service[103801]: Gracefully killing worker 2 (pid: 103801)... Jul 21 20:03:52.789994 dv-cinder-850548-2-iscsi devstack@n-api.service[103799]: worker 1 buried after 1 seconds Jul 21 20:03:52.790508 dv-cinder-850548-2-iscsi devstack@n-api.service[103799]: worker 2 buried after 1 seconds Jul 21 20:03:52.790508 dv-cinder-850548-2-iscsi devstack@n-api.service[103799]: goodbye to uWSGI. Jul 21 20:03:52.791632 dv-cinder-850548-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 21 20:03:52.792186 dv-cinder-850548-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 21 20:03:52.794974 dv-cinder-850548-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 21 20:03:52.805792 dv-cinder-850548-2-iscsi devstack@n-api.service[118328]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 21 20:03:52.807904 dv-cinder-850548-2-iscsi devstack@n-api.service[118328]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 21 20:03:52 2022] *** Jul 21 20:03:52.807904 dv-cinder-850548-2-iscsi devstack@n-api.service[118328]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 21 20:03:52.807904 dv-cinder-850548-2-iscsi devstack@n-api.service[118328]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 21 20:03:52.807904 dv-cinder-850548-2-iscsi devstack@n-api.service[118328]: nodename: dv-cinder-850548-2-iscsi Jul 21 20:03:52.807904 dv-cinder-850548-2-iscsi devstack@n-api.service[118328]: machine: x86_64 Jul 21 20:03:52.807904 dv-cinder-850548-2-iscsi devstack@n-api.service[118328]: clock source: unix Jul 21 20:03:52.807904 dv-cinder-850548-2-iscsi devstack@n-api.service[118328]: pcre jit disabled Jul 21 20:03:52.807904 dv-cinder-850548-2-iscsi devstack@n-api.service[118328]: detected number of CPU cores: 4 Jul 21 20:03:52.807904 dv-cinder-850548-2-iscsi devstack@n-api.service[118328]: current working directory: / Jul 21 20:03:52.807904 dv-cinder-850548-2-iscsi devstack@n-api.service[118328]: detected binary path: /usr/bin/uwsgi-core Jul 21 20:03:52.807904 dv-cinder-850548-2-iscsi devstack@n-api.service[118328]: your processes number limit is 47680 Jul 21 20:03:52.807904 dv-cinder-850548-2-iscsi devstack@n-api.service[118328]: your memory page size is 4096 bytes Jul 21 20:03:52.808707 dv-cinder-850548-2-iscsi devstack@n-api.service[118328]: detected max file descriptor number: 2048 Jul 21 20:03:52.808707 dv-cinder-850548-2-iscsi devstack@n-api.service[118328]: lock engine: pthread robust mutexes Jul 21 20:03:52.808707 dv-cinder-850548-2-iscsi devstack@n-api.service[118328]: thunder lock: enabled Jul 21 20:03:52.808707 dv-cinder-850548-2-iscsi devstack@n-api.service[118328]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 21 20:03:52.808707 dv-cinder-850548-2-iscsi devstack@n-api.service[118328]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 21 20:03:52.852623 dv-cinder-850548-2-iscsi devstack@n-api.service[118328]: Python main interpreter initialized at 0x5610d84909c0 Jul 21 20:03:52.852623 dv-cinder-850548-2-iscsi devstack@n-api.service[118328]: python threads support enabled Jul 21 20:03:52.852623 dv-cinder-850548-2-iscsi devstack@n-api.service[118328]: your server socket listen backlog is limited to 100 connections Jul 21 20:03:52.852623 dv-cinder-850548-2-iscsi devstack@n-api.service[118328]: your mercy for graceful operations on workers is 90 seconds Jul 21 20:03:52.853070 dv-cinder-850548-2-iscsi devstack@n-api.service[118328]: mapped 403077 bytes (393 KB) for 2 cores Jul 21 20:03:52.853070 dv-cinder-850548-2-iscsi devstack@n-api.service[118328]: *** Operational MODE: preforking *** Jul 21 20:03:52.853327 dv-cinder-850548-2-iscsi devstack@n-api.service[118328]: *** uWSGI is running in multiple interpreter mode *** Jul 21 20:03:52.853327 dv-cinder-850548-2-iscsi devstack@n-api.service[118328]: spawned uWSGI master process (pid: 118328) Jul 21 20:03:52.853553 dv-cinder-850548-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 21 20:03:52.854111 dv-cinder-850548-2-iscsi devstack@n-api.service[118328]: spawned uWSGI worker 1 (pid: 118344, cores: 1) Jul 21 20:03:52.855055 dv-cinder-850548-2-iscsi devstack@n-api.service[118328]: spawned uWSGI worker 2 (pid: 118345, cores: 1) Jul 21 20:03:52.855055 dv-cinder-850548-2-iscsi devstack@n-api.service[118328]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 21 20:03:53.514430 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 21 20:03:53.515160 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 21 20:03:54.714890 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 20:03:54.714890 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: from cryptography.utils import int_from_bytes Jul 21 20:03:54.715517 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 20:03:54.715517 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: from cryptography.utils import int_from_bytes Jul 21 20:03:54.715901 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 20:03:54.715901 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: from cryptography.utils import int_from_bytes Jul 21 20:03:54.716024 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 20:03:54.716024 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: from cryptography.utils import int_from_bytes Jul 21 20:03:57.026296 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 21 20:03:57.026834 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 21 20:03:57.027104 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 21 20:03:57.027466 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 21 20:03:57.027735 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 21 20:03:57.028130 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.028473 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.028798 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.029333 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.029673 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.030007 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.030332 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.030655 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.031004 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.031288 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.031625 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.031954 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850548-2-iscsi {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.032260 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 21 20:03:57.032631 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.032718 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 21 20:03:57.032808 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.032900 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.033159 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 21 20:03:57.033268 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.033494 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.033594 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 21 20:03:57.033769 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 21 20:03:57.033870 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.034114 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.034216 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.034462 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.034615 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.034782 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.035107 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.035277 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.035396 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.035515 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.035704 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.035841 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.036046 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.036193 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.036360 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.036504 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.036677 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.036796 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.036913 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.037006 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.037224 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.037325 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.037547 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850548-2-iscsi {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.037699 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.037848 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.037951 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.038152 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.038307 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850548-2-iscsi {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.038461 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.038635 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.039298 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.039512 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.039607 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.039839 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.039945 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.040205 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.040295 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.040561 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.040709 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.040870 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.041016 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.041190 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.041319 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.041517 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.041677 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.041829 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.041933 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.042163 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.042255 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.042506 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.042617 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.042814 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.042914 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.043160 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.043268 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.043467 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.043559 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.043780 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.043883 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.044093 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.044193 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850548-2-iscsi {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.044418 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.044519 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.044726 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.044826 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.045033 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.045125 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.045286 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.045458 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.045599 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.045769 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.045924 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.046091 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.046317 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.046415 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.046674 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.046782 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.046874 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.046989 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.047169 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.047341 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.047445 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.047662 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.047815 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.047977 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.048079 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.048286 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.048378 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.048583 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.048672 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.048888 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.048980 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.049193 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.049297 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.049500 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.049590 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.049799 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.049890 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.050097 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.050188 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.050343 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.050449 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.050648 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.050741 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.050967 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.051105 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.051309 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.051412 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.051628 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.051729 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.051862 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.052044 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.052136 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.052301 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.052394 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.052612 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.052710 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.052953 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.053059 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.053276 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.053376 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.053587 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.053679 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.053888 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.053993 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.054191 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.054290 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.055103 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.055246 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.055444 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.055550 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.055758 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.055890 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.056083 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.056211 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.056402 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.056535 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.056763 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.056893 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.057023 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.057142 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.057268 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.057389 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.057559 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.057710 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.057911 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.058030 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.058179 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.058300 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.058489 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.058616 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.058799 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.058926 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.059126 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.059261 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.059441 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.060616 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.060813 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.060914 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.061011 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.061105 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.061190 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.061272 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.061354 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.061453 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.061544 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.061628 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.061710 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.061799 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.061889 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.062040 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.062040 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.062213 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.062304 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.062388 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.062470 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.062561 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.062651 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.062734 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.062954 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.063070 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.064017 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.064203 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.064370 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.064514 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.064618 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.064711 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.064798 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.064888 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.064981 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.065071 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.065163 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.065248 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.065330 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.065411 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.065493 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.065584 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.065758 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.065860 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.066068 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.066168 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.066376 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.066477 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.066698 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.066791 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.067001 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.067190 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.067332 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.067446 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.067652 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.067744 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.067962 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.068080 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.068266 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.068378 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.068570 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.068666 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.068876 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.068977 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.069177 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.069277 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.069481 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.069582 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.069788 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.069927 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.070157 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.070333 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.070472 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.070578 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.070722 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.070814 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.071042 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.071176 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.071350 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.071495 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.071667 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.071806 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.071965 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.072107 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.072271 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.072426 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.072582 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.072767 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.072870 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.073105 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.073197 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.073452 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.073555 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.073760 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.073857 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.074059 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.074234 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.074362 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.074455 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.074662 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.074766 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.074961 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.075087 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.075284 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.075385 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.075599 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.075692 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.075917 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.076024 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.076224 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.076317 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.076526 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.076618 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.076829 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.076929 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.077145 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:03:57.077237 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.077477 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.077577 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.077807 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.077908 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.078140 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.078238 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.078451 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.078540 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.078768 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.078860 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.079114 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.079223 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.079432 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.079529 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.079744 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.079855 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.080061 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.080174 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.080391 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.080519 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.080704 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.080810 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.081015 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.081122 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.081325 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.081428 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.081641 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.081743 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.081959 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.082060 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.082276 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.082380 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.082590 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.082683 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.082905 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.083012 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.083267 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.083374 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.083588 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.083682 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.083903 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.084006 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.084217 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.084318 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.084536 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.084731 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.084863 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.084950 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.085156 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.085255 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.085472 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.085574 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.085831 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.085924 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.086149 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.086258 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.086465 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.086564 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.086776 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.086876 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.087157 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.087268 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.087427 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.087528 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.087728 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.087822 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.088043 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.088171 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.088350 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.088444 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.088659 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.088759 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.088965 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.089073 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.089279 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.089373 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.089584 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.089678 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.089906 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.089999 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.090218 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.090313 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.090590 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.090754 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.090856 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.090940 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.091173 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.091306 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.091487 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.091854 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.092078 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.092219 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.092406 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.092584 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.092721 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.092900 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.093035 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.093211 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.093332 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.093565 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.093705 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.093872 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.094001 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.094176 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.094304 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.094486 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.094606 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.094789 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.094910 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.095130 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.095263 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.095456 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.095585 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.095771 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.095889 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.096085 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.096205 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.096393 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.096519 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.096703 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.096835 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.097010 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.097137 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.097319 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.097448 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.097621 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.097740 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.097932 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.098050 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.098301 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.098444 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.098558 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.098670 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.098845 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.098974 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.099250 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.099390 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.099621 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.099749 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.099957 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.100113 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.100269 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.100407 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.100591 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.100749 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.100906 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.101065 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.101748 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.101899 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.102024 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.102116 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.102338 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.102427 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.102646 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.102749 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.102953 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.103091 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.103287 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.103389 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.103606 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.103707 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.103915 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.104008 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.104242 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.104342 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.104556 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.104655 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.104863 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.104955 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.105171 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.105278 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.105480 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.105651 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.106179 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.106289 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.106383 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.106478 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.106565 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.106648 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.106830 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.107123 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.107245 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.107404 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.107500 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.107712 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.107821 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.108015 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.108123 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.108317 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.108424 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.108619 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.108716 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.108919 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.109032 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.109218 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.109344 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.109538 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.109668 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.109847 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.110006 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.110307 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.110604 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.110723 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.110917 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.111041 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.111288 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.111405 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.111611 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.111946 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.112113 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.112277 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.112458 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.112661 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.112774 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.113011 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.113242 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.113357 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.113572 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.113665 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.113953 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.114076 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.114272 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.114382 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.114589 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.114687 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.114906 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.115005 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.115246 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.115357 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.115562 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.115663 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.115884 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.115976 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.116196 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.116297 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.116518 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.116618 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.116832 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.116983 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.117713 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.117816 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.118028 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.118128 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.118352 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.118470 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.118660 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.118764 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.118976 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.119100 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.119322 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.119426 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.119658 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.119759 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.119972 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.120112 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.120292 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.120384 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.120630 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.120779 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.120924 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.121030 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.121245 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.121396 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.121551 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.121650 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.121857 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.121956 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.122166 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.122269 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.122477 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.122569 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.122793 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.122884 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.123122 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.123235 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.123436 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.123535 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.123744 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.123835 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.124060 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.124160 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.124366 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.124464 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.124670 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.124761 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.124970 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.125069 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.125280 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.125380 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.125603 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.125693 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.125919 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.126025 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.126228 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.126317 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.126538 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.126630 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.126849 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.126940 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.127181 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.127286 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.127501 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.127593 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.127811 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.127911 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.128113 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.128204 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.128417 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.128508 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.128723 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.128815 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.129035 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.129134 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.129344 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.129485 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.129655 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.129754 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.129959 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.130051 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.130272 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.130372 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.130577 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.130716 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.130878 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.130976 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.131205 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.131324 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.131517 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.131622 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.131832 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.131933 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.132142 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.132317 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.132453 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.133064 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.133286 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.133601 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.133956 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.134275 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.134604 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.134919 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.135281 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.135459 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.135598 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.135824 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.135954 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.136139 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.136267 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.136475 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.136609 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.136794 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.137096 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.137217 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.137401 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.137522 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.137709 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.137830 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.138054 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.138173 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.138367 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.138493 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.138674 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.138804 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.138993 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.139150 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.139341 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.139478 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.139653 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.139774 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.140114 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.140443 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.140761 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.141032 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.141179 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.141369 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.141478 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.141740 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.141884 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.142029 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.142181 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.142328 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.142428 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.142592 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.142707 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.142883 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.142989 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.143303 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.143444 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.143620 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.143748 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.143930 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.144060 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.144250 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.144382 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.144557 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.144654 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.144871 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.144972 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.145186 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.145288 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.145514 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.145615 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.145829 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.145922 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.146140 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.146242 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.146450 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.146744 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.146844 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.147102 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.147218 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.147419 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.147518 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.147738 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.147836 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.148059 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.148214 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.149024 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.149137 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.149270 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.149364 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.149582 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.149684 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.149915 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.150008 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.150226 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.150333 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.150540 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.150640 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.150845 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.150936 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.158479 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.158615 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.158867 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.158956 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.159067 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.159166 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.159259 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.159343 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.159426 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.159508 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.159590 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.159687 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.159771 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.159853 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.159935 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.160025 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.160115 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.160256 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.160351 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.160441 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.160534 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.160668 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.160762 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.160858 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.161006 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.161118 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.161246 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.161378 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.161378 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.161548 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.161639 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.161772 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.161898 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.161998 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.162096 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.162220 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.162312 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.162395 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.162524 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.162623 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.162763 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.162856 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.162955 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.163075 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.163163 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.163246 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.163347 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.163440 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.163532 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.163623 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.163734 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.163837 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.163923 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.164012 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.164096 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.164183 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.164275 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.164369 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.164504 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.164624 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.164738 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.164857 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.164969 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.165094 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.165207 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.165317 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.165435 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.165547 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.165665 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.165787 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.165900 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.165993 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.166078 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.166149 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.166232 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.166310 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.166387 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.166463 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.166540 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.166616 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.166699 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.166770 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.166846 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.166916 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.166985 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.166985 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.167215 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.167290 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.167367 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.167454 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.167532 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.167602 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.167679 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.167757 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.167834 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.167834 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.167834 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.167834 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.168105 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.168176 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.168244 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.168319 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.168395 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.168473 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.168551 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.168629 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.168699 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.168768 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.168843 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.168931 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.169009 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.169130 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.169265 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.169353 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.169548 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.169548 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.169754 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.169945 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.175068 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.175213 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.175213 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.175388 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.175479 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.175601 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.175688 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.175793 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.175903 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.175978 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.176056 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.176135 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.176205 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.176274 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.176417 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.176417 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.176548 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.176625 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.176696 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.176764 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.176843 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.176922 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.176994 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.177076 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.177146 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.177223 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.177303 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.177381 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.177453 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.177536 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.177615 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.177699 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.177778 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.177849 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.177918 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.177994 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.178064 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.178147 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.178220 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.178296 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.178375 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.178453 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.178453 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.178593 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.178672 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.178750 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.178820 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.178897 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.178967 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.179201 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.179285 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.179408 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.179495 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.179574 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.179654 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.179727 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.179797 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.179874 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.179952 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.180029 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.180114 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.180186 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.180265 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.180360 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.180437 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.181345 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.181470 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.181556 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.181629 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.181700 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.182208 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.182308 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.182419 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.182502 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.182582 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.182582 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.182742 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.182827 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.182899 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.182970 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.183237 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.183330 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.184114 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.184225 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.184225 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.184367 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.184444 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.184515 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.184584 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.184663 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.185130 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.185264 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.185348 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.185427 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.185506 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.185697 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.185778 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.186055 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.186155 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.186315 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.186418 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.186590 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.186698 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.186914 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.187056 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.187298 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.187410 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.187626 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.187723 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.187954 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.188049 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.188338 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.188441 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.188663 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.188766 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.188978 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.189078 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.189291 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.189455 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.189662 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.189755 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.190003 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.190098 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.190316 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.190409 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.190648 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.190740 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.190968 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.191181 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.193026 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.193121 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.193238 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.193315 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.193393 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.193465 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.193863 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.193957 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.194030 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.194100 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.194100 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.194233 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.194314 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.194393 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.194471 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.194542 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.194611 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.194689 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.194767 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.194844 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.194915 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.195741 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.195894 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.196051 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.196208 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.196402 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.196555 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.196704 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.196856 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.196856 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.197151 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.197296 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.197447 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.197627 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.197815 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.197976 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.198132 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.198285 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.198440 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.198598 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.198784 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.198936 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.199144 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.199144 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.199433 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.199433 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.199869 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.200072 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.200221 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.200382 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.200537 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.200682 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.200834 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.200988 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.201184 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.201331 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.201759 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.201947 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.202097 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.202486 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.202638 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.202782 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.202956 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.203137 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.203345 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.203501 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.203673 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.203981 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.204143 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.204329 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.204481 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.204634 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.204787 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.204942 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.205087 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.205243 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.205425 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.205581 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.205761 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.205924 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.206115 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.206260 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.206404 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.206554 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.206703 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.206861 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.207006 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.207211 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.207374 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.207575 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.207728 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.207892 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.208044 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.208205 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.208358 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.208507 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.208671 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.208823 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.208973 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.209122 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.209283 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.209433 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.209433 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.209763 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.209948 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.210131 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.210379 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.210606 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.211332 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.211501 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.211920 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.212089 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.212248 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.212622 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.212795 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.212948 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.213107 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.213266 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.213418 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.213581 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.213740 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.214104 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.214277 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.214430 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.214606 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.214964 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.215147 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.215311 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.215464 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.215661 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.215827 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.215988 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.216142 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.216300 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.216464 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.216882 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.217035 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.217197 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.217369 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.217527 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.217678 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.217678 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.218022 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.218218 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.218382 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.218382 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.218676 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.218676 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.218975 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.219166 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.219320 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.219481 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.219631 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.220032 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.220206 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.220361 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.220511 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.220670 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.220829 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.220979 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.221143 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.221296 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.221454 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.221612 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.221946 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.222201 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.222359 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.222736 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.222898 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.223070 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.223239 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.223406 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.223567 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.223567 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.223886 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.224145 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.224407 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.224575 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.224727 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.224885 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.225036 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.225185 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.225342 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.225502 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.225653 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.225804 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.225953 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.226136 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.226354 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.226523 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.226686 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.226838 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.226995 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.227170 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.227339 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.227502 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.227734 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.227937 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.228095 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.228254 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.228419 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.228583 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.228583 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.228912 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.228912 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.229260 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.229422 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.229574 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.229723 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.229920 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.229920 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.230218 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.230370 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.230528 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.230701 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.230854 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.231069 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.231241 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.231241 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.231536 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.231694 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.231865 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.232189 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.232430 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.232615 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.232969 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.233180 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.233345 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.233543 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.233705 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.233856 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.234008 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.234255 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.234526 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.234693 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.234853 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.235180 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.235343 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.235506 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.235670 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.235829 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.236015 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.236179 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.236342 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.236342 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.236665 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.236825 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.236976 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.237134 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.237316 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.237477 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.237728 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.237891 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.238051 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.238051 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.238348 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.238348 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.238656 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.238815 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.238966 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.239222 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.239422 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.239591 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.239750 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.239921 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.240087 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.240087 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.240373 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.240572 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.240733 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.240892 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.241043 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.241200 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.241352 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.241549 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.241705 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.241910 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.242225 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.242393 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.242806 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.243220 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.243383 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.243544 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.243703 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.243862 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.244058 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.244233 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.244458 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.244458 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.244919 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.244919 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.245220 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.245375 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.245535 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.245745 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.246078 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.246327 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.246557 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.246792 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.246912 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.247084 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.254066 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.254262 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.254447 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.254690 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.255064 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.255230 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.255399 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.255567 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.255720 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.255879 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.256032 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.256192 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.256365 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.256519 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.256519 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.256862 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.257027 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.257186 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.257347 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.258046 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.258254 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.258419 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.258610 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.258766 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.258931 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.259188 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.259352 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.259504 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.259663 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.259814 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.259974 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.259974 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.260304 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.260467 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.260619 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.260779 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.260779 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.261087 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.261248 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.261400 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.261550 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.261710 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.261880 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.262228 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.262542 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.262700 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.262870 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.263462 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.263628 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.263780 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.263951 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.264112 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.264309 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.264484 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.264752 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.264918 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.265078 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.265248 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.265502 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.265661 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.265812 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.265962 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.266121 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.266288 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.266455 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.266616 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.266768 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.266918 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.267087 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.267087 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.267407 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.267608 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.267760 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.267925 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.268083 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.268083 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.268390 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.268544 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.268702 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.268854 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.269005 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.269165 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.269316 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.269316 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.269602 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.269754 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.269951 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.270124 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.270288 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.270447 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.270613 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.270777 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.270930 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.271114 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.271273 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.271431 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.271590 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.271742 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.271911 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.272077 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.272332 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.272748 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.272913 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.273073 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.274221 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.274383 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.274535 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.274830 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.275092 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.275263 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.275427 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.275711 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.275911 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.276087 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.276241 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.276426 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.276595 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.276749 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.276943 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.277115 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.277278 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.277475 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.277653 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.277807 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.278001 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.278158 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.278322 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.278517 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.278676 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.278836 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.278996 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.279173 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.279326 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.279494 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.279679 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.279836 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.279995 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.280182 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.280338 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.280511 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.280663 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.280813 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.280966 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.281118 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.281282 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.281443 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.281603 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.281603 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.281930 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.282089 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.282305 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.282555 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.282930 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.283159 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.283278 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.283390 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.287263 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.287449 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.287605 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.287758 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.287941 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.287941 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.288257 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.288418 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.288593 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.288772 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.288930 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.289097 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.289258 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.289419 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.289573 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.289723 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.289882 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.290047 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.290200 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.290350 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.290545 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.290703 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.290703 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.291238 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.291430 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.291592 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.291747 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.291946 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.292147 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.292147 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.292521 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.292765 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.293107 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.293288 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.293451 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.293604 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.293766 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.293926 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.294079 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.294678 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.294678 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.294997 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.295224 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.295480 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.295646 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.296690 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.296862 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.297025 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.297181 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.297333 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.297499 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.297662 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.297815 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.297969 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.298121 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.298282 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.298443 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.298697 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.298879 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.299089 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.299262 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.299416 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.299578 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.299742 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.300040 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.300215 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.300371 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.300560 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.300733 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.300888 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.301048 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.301226 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.301380 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.301540 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.301706 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.301866 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.302021 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.302174 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.302325 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.302476 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.302637 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.302637 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.303346 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.303521 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.303682 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.303843 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.304004 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.304156 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.304415 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.305085 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.305243 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.305407 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.305684 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.305852 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.306017 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.306171 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.306345 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.306514 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.306692 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.307002 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.307210 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.307367 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.307532 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.307686 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.307839 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.307990 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.308149 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.308303 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.308303 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.308303 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.308760 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.308921 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.309074 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.309233 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.309395 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.309558 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.309711 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.309863 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.310023 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.310183 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.310375 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.310645 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.310893 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.311146 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.311302 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.311468 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.311468 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.311779 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.311931 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.312090 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.312242 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.312351 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.312434 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.312528 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.312614 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.312709 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.312794 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.312908 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.313198 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.313558 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.313688 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.313816 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.313941 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.314064 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.314186 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.314186 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.314186 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.314186 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.314186 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.314186 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.314186 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.314186 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.315603 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.315853 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.315986 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 21 20:03:57.316145 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.316145 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.316145 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.316145 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.316145 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.316145 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.316145 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.316145 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.317298 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.317298 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.317298 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.317298 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.317298 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.317298 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.317298 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.317298 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.318128 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.318128 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.318128 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.318128 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.318128 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.318128 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.318128 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.318128 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.318987 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.318987 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.318987 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.318987 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.318987 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.318987 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.318987 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.318987 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.320515 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.320515 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.320515 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.320515 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.320515 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.320515 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.320515 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.320515 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.321474 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.321474 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.321474 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.321474 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.321474 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.321474 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.321474 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.321474 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.322301 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.322301 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.322301 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.322301 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.322301 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.322301 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.322301 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.322301 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.323451 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.323451 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:03:57.323451 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 21 20:03:57.448453 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO dbcounter [None req-fb8c66ae-67b9-4628-864d-c62b1051419d None None] Registered counter for database nova_api Jul 21 20:03:57.468654 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_db.sqlalchemy.engines [None req-fb8c66ae-67b9-4628-864d-c62b1051419d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118344) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 20:03:57.469593 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO dbcounter [None req-24bd488a-7c2a-4595-9466-60b9bc688c84 None None] Registered counter for database nova_api Jul 21 20:03:57.475430 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG dbcounter [-] [118344] Writer thread running {{(pid=118344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 20:03:57.489277 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_db.sqlalchemy.engines [None req-24bd488a-7c2a-4595-9466-60b9bc688c84 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118345) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 20:03:57.496267 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writer thread running {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 20:03:57.539629 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.context [None req-fb8c66ae-67b9-4628-864d-c62b1051419d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c67a2928-fd99-4ffe-bc44-a4ed319a28fe(cell1) {{(pid=118344) load_cells /opt/stack/nova/nova/context.py:464}} Jul 21 20:03:57.543717 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-fb8c66ae-67b9-4628-864d-c62b1051419d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:03:57.545289 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-fb8c66ae-67b9-4628-864d-c62b1051419d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:03:57.546095 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-fb8c66ae-67b9-4628-864d-c62b1051419d None None] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:03:57.548084 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-fb8c66ae-67b9-4628-864d-c62b1051419d None None] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:03:57.550062 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO dbcounter [None req-fb8c66ae-67b9-4628-864d-c62b1051419d None None] Registered counter for database nova_cell0 Jul 21 20:03:57.552089 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.context [None req-24bd488a-7c2a-4595-9466-60b9bc688c84 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c67a2928-fd99-4ffe-bc44-a4ed319a28fe(cell1) {{(pid=118345) load_cells /opt/stack/nova/nova/context.py:464}} Jul 21 20:03:57.554113 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO dbcounter [None req-fb8c66ae-67b9-4628-864d-c62b1051419d None None] Registered counter for database nova_cell1 Jul 21 20:03:57.556719 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-24bd488a-7c2a-4595-9466-60b9bc688c84 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:03:57.558309 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-24bd488a-7c2a-4595-9466-60b9bc688c84 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:03:57.559321 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-24bd488a-7c2a-4595-9466-60b9bc688c84 None None] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:03:57.561356 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-24bd488a-7c2a-4595-9466-60b9bc688c84 None None] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:03:57.562025 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_db.sqlalchemy.engines [None req-fb8c66ae-67b9-4628-864d-c62b1051419d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118344) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 20:03:57.563422 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO dbcounter [None req-24bd488a-7c2a-4595-9466-60b9bc688c84 None None] Registered counter for database nova_cell0 Jul 21 20:03:57.563767 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_db.sqlalchemy.engines [None req-fb8c66ae-67b9-4628-864d-c62b1051419d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118344) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 20:03:57.567490 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO dbcounter [None req-24bd488a-7c2a-4595-9466-60b9bc688c84 None None] Registered counter for database nova_cell1 Jul 21 20:03:57.569634 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG dbcounter [-] [118344] Writer thread running {{(pid=118344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 20:03:57.572911 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG dbcounter [-] [118344] Writer thread running {{(pid=118344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 20:03:57.575233 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_db.sqlalchemy.engines [None req-24bd488a-7c2a-4595-9466-60b9bc688c84 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118345) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 20:03:57.577099 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_db.sqlalchemy.engines [None req-24bd488a-7c2a-4595-9466-60b9bc688c84 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118345) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 20:03:57.582701 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writer thread running {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 20:03:57.585378 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writer thread running {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 20:03:57.718383 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO dbcounter [None req-fb8c66ae-67b9-4628-864d-c62b1051419d None None] Registered counter for database nova_cell0 Jul 21 20:03:57.725061 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_db.sqlalchemy.engines [None req-fb8c66ae-67b9-4628-864d-c62b1051419d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118344) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 20:03:57.730018 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG dbcounter [-] [118344] Writer thread running {{(pid=118344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 20:03:57.731897 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO dbcounter [None req-24bd488a-7c2a-4595-9466-60b9bc688c84 None None] Registered counter for database nova_cell0 Jul 21 20:03:57.738403 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_db.sqlalchemy.engines [None req-24bd488a-7c2a-4595-9466-60b9bc688c84 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118345) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 20:03:57.743689 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writer thread running {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 20:03:58.051663 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: WARNING keystonemiddleware.auth_token [None req-fb8c66ae-67b9-4628-864d-c62b1051419d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 21 20:03:58.059053 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: WARNING keystonemiddleware.auth_token [None req-fb8c66ae-67b9-4628-864d-c62b1051419d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 21 20:03:58.064978 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: WARNING keystonemiddleware.auth_token [None req-24bd488a-7c2a-4595-9466-60b9bc688c84 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 21 20:03:58.072841 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: WARNING keystonemiddleware.auth_token [None req-24bd488a-7c2a-4595-9466-60b9bc688c84 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 21 20:03:58.401902 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: WARNING keystonemiddleware.auth_token [None req-fb8c66ae-67b9-4628-864d-c62b1051419d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 21 20:03:58.408401 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: WARNING keystonemiddleware.auth_token [None req-fb8c66ae-67b9-4628-864d-c62b1051419d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 21 20:03:58.414704 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5610d84909c0 pid: 118344 (default app) Jul 21 20:03:58.420516 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: WARNING keystonemiddleware.auth_token [None req-24bd488a-7c2a-4595-9466-60b9bc688c84 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 21 20:03:58.426565 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: WARNING keystonemiddleware.auth_token [None req-24bd488a-7c2a-4595-9466-60b9bc688c84 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 21 20:03:58.433387 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5610d84909c0 pid: 118345 (default app) Jul 21 20:04:41.286470 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG dbcounter [-] [118344] Writing DB stats nova_api:SELECT=3 {{(pid=118344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:04:41.287563 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG dbcounter [-] [118344] Writing DB stats nova_cell0:SELECT=3 {{(pid=118344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:04:41.289554 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG dbcounter [-] [118344] Writing DB stats nova_cell1:SELECT=3 {{(pid=118344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:04:41.292144 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG dbcounter [-] [118344] Writing DB stats nova_cell0:SELECT=3 {{(pid=118344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:04:42.516018 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-35b43c6a-e78a-4af0-8fc4-c3418dc412e4 tempest-VolumesSnapshotsTestJSON-1060885163 tempest-VolumesSnapshotsTestJSON-1060885163-project] Action: 'create', calling method: .version_select at 0x7f351eca2ca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1069010190"}} {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:04:44.862567 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-35b43c6a-e78a-4af0-8fc4-c3418dc412e4 tempest-VolumesSnapshotsTestJSON-1060885163 tempest-VolumesSnapshotsTestJSON-1060885163-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.584181 Jul 21 20:04:44.872649 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 1/1] 10.222.0.58 () {60 vars in 1154 bytes} [Thu Jul 21 20:04:41 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3597 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 21 20:04:45.285323 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-55b04b88-0f55-43c7-8c32-aeb285f0fed3 tempest-VolumesSnapshotsTestJSON-1060885163 tempest-VolumesSnapshotsTestJSON-1060885163-project] Calling method '.version_select at 0x7f351ed5c820>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:04:45.321939 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_api:SELECT=3 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:04:45.323227 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell0:SELECT=3 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:04:45.324185 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell1:SELECT=3 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:04:45.325186 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell0:SELECT=3 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:04:46.104560 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-55b04b88-0f55-43c7-8c32-aeb285f0fed3 tempest-VolumesSnapshotsTestJSON-1060885163 tempest-VolumesSnapshotsTestJSON-1060885163-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/cda54436-5fb1-4d4f-8c93-f365f35e9fbf" status: 200 len: 345 microversion: 2.1 time: 1.230626 Jul 21 20:04:46.110463 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 1/2] 10.222.0.58 () {58 vars in 1244 bytes} [Thu Jul 21 20:04:44 2022] GET /compute/v2.1/os-volumes/cda54436-5fb1-4d4f-8c93-f365f35e9fbf => generated 345 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:04:47.121443 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-129d442f-2d98-4ab3-9d75-1b742de4ff8b tempest-VolumesSnapshotsTestJSON-1060885163 tempest-VolumesSnapshotsTestJSON-1060885163-project] Calling method '.version_select at 0x7f351eb64af0>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:04:47.236372 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-129d442f-2d98-4ab3-9d75-1b742de4ff8b tempest-VolumesSnapshotsTestJSON-1060885163 tempest-VolumesSnapshotsTestJSON-1060885163-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/cda54436-5fb1-4d4f-8c93-f365f35e9fbf" status: 200 len: 346 microversion: 2.1 time: 0.122540 Jul 21 20:04:47.244164 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 2/3] 10.222.0.58 () {58 vars in 1244 bytes} [Thu Jul 21 20:04:47 2022] GET /compute/v2.1/os-volumes/cda54436-5fb1-4d4f-8c93-f365f35e9fbf => generated 346 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:04:47.250739 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-6ef442c2-d049-49f9-be8a-7e6fe259c668 tempest-VolumesSnapshotsTestJSON-1060885163 tempest-VolumesSnapshotsTestJSON-1060885163-project] Action: 'create', calling method: .version_select at 0x7f351ebaad30>, body: {"snapshot": {"volume_id": "cda54436-5fb1-4d4f-8c93-f365f35e9fbf", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1239363227"}} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:04:48.183859 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-6ef442c2-d049-49f9-be8a-7e6fe259c668 tempest-VolumesSnapshotsTestJSON-1060885163 tempest-VolumesSnapshotsTestJSON-1060885163-project] 10.222.0.58 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.936745 Jul 21 20:04:48.183859 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 2/4] 10.222.0.58 () {60 vars in 1161 bytes} [Thu Jul 21 20:04:47 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:04:48.193800 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-f60d78d9-6a86-4dc6-b88e-281e3ccc9dc4 tempest-VolumesSnapshotsTestJSON-1060885163 tempest-VolumesSnapshotsTestJSON-1060885163-project] Calling method '.version_select at 0x7f351eb64c10>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:04:48.359231 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-f60d78d9-6a86-4dc6-b88e-281e3ccc9dc4 tempest-VolumesSnapshotsTestJSON-1060885163 tempest-VolumesSnapshotsTestJSON-1060885163-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/6753ce8a-a560-46e1-bf29-6dff8d7dde40" status: 200 len: 287 microversion: 2.1 time: 0.169572 Jul 21 20:04:48.365192 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 3/5] 10.222.0.58 () {58 vars in 1250 bytes} [Thu Jul 21 20:04:48 2022] GET /compute/v2.1/os-snapshots/6753ce8a-a560-46e1-bf29-6dff8d7dde40 => generated 287 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:04:48.372197 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-a4d9ede1-81e7-461d-82d6-721cf9b28835 tempest-VolumesSnapshotsTestJSON-1060885163 tempest-VolumesSnapshotsTestJSON-1060885163-project] Calling method '.version_select at 0x7f351eb763a0>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:04:48.428735 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-a4d9ede1-81e7-461d-82d6-721cf9b28835 tempest-VolumesSnapshotsTestJSON-1060885163 tempest-VolumesSnapshotsTestJSON-1060885163-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.061708 Jul 21 20:04:48.429908 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 3/6] 10.222.0.58 () {58 vars in 1139 bytes} [Thu Jul 21 20:04:48 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:04:48.448940 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-60e97e49-101a-4b32-971d-aa96c668f2d0 tempest-VolumesSnapshotsTestJSON-1060885163 tempest-VolumesSnapshotsTestJSON-1060885163-project] Calling method '.version_select at 0x7f351eb88310>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:04:48.559900 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-60e97e49-101a-4b32-971d-aa96c668f2d0 tempest-VolumesSnapshotsTestJSON-1060885163 tempest-VolumesSnapshotsTestJSON-1060885163-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/6753ce8a-a560-46e1-bf29-6dff8d7dde40" status: 200 len: 287 microversion: 2.1 time: 0.122447 Jul 21 20:04:48.566602 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 4/7] 10.222.0.58 () {58 vars in 1250 bytes} [Thu Jul 21 20:04:48 2022] GET /compute/v2.1/os-snapshots/6753ce8a-a560-46e1-bf29-6dff8d7dde40 => generated 287 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:04:49.581980 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-bd4c0599-69b1-4ad9-9928-352df9fdc55c tempest-VolumesSnapshotsTestJSON-1060885163 tempest-VolumesSnapshotsTestJSON-1060885163-project] Calling method '.version_select at 0x7f351eb870d0>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:04:49.638287 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-bd4c0599-69b1-4ad9-9928-352df9fdc55c tempest-VolumesSnapshotsTestJSON-1060885163 tempest-VolumesSnapshotsTestJSON-1060885163-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/6753ce8a-a560-46e1-bf29-6dff8d7dde40" status: 200 len: 287 microversion: 2.1 time: 0.065243 Jul 21 20:04:49.647712 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 4/8] 10.222.0.58 () {58 vars in 1250 bytes} [Thu Jul 21 20:04:49 2022] GET /compute/v2.1/os-snapshots/6753ce8a-a560-46e1-bf29-6dff8d7dde40 => generated 287 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:04:50.660978 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-7e1e7769-795e-40bf-b066-7003947bacb9 tempest-VolumesSnapshotsTestJSON-1060885163 tempest-VolumesSnapshotsTestJSON-1060885163-project] Calling method '.version_select at 0x7f351eb889d0>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:04:50.712296 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-7e1e7769-795e-40bf-b066-7003947bacb9 tempest-VolumesSnapshotsTestJSON-1060885163 tempest-VolumesSnapshotsTestJSON-1060885163-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/6753ce8a-a560-46e1-bf29-6dff8d7dde40" status: 200 len: 287 microversion: 2.1 time: 0.057031 Jul 21 20:04:50.717390 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 5/9] 10.222.0.58 () {58 vars in 1250 bytes} [Thu Jul 21 20:04:50 2022] GET /compute/v2.1/os-snapshots/6753ce8a-a560-46e1-bf29-6dff8d7dde40 => generated 287 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:04:51.725754 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-c3a76b22-3deb-4f8c-bb10-9f9946296fd3 tempest-VolumesSnapshotsTestJSON-1060885163 tempest-VolumesSnapshotsTestJSON-1060885163-project] Calling method '.version_select at 0x7f351ebaaf70>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:04:51.789517 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-c3a76b22-3deb-4f8c-bb10-9f9946296fd3 tempest-VolumesSnapshotsTestJSON-1060885163 tempest-VolumesSnapshotsTestJSON-1060885163-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/6753ce8a-a560-46e1-bf29-6dff8d7dde40" status: 200 len: 287 microversion: 2.1 time: 0.067643 Jul 21 20:04:51.790806 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 5/10] 10.222.0.58 () {58 vars in 1250 bytes} [Thu Jul 21 20:04:51 2022] GET /compute/v2.1/os-snapshots/6753ce8a-a560-46e1-bf29-6dff8d7dde40 => generated 287 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:04:52.350893 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-d76b28e6-2373-4bf7-bd01-a4b86b5815d4 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Action: 'create', calling method: .version_select at 0x7f351eb88ca0>, body: {"keypair": {"name": "tempest-keypair-2054628863", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKK9tsAYPrVjWFdOCFyMuzi90fLLQEtj0bNV45yP2wORVijwZhPxQz5we4940jBlscKdBAe3YvKt+tXjWkBfGXIyNbUh/+2F3lCigG/1z8TZSd/gz2OoUmdD/ZsDxXJS+Q=="}} {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:04:52.418233 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.quota [None req-d76b28e6-2373-4bf7-bd01-a4b86b5815d4 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Getting quotas for project e0075f5ba84547c782504d23f6029fd2. Resources: {'key_pairs'} {{(pid=118344) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 20:04:52.427384 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.quota [None req-d76b28e6-2373-4bf7-bd01-a4b86b5815d4 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Getting quotas for user d04a0e68aea7424181f6c2728cbf7e3f and project e0075f5ba84547c782504d23f6029fd2. Resources: {'key_pairs'} {{(pid=118344) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 20:04:52.609844 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-d76b28e6-2373-4bf7-bd01-a4b86b5815d4 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.804250 Jul 21 20:04:52.615490 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 6/11] 10.222.0.58 () {60 vars in 1158 bytes} [Thu Jul 21 20:04:51 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:04:52.801833 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-5973b269-dbc4-4e41-a3d8-b70f08cabe6d tempest-VolumesSnapshotsTestJSON-1060885163 tempest-VolumesSnapshotsTestJSON-1060885163-project] Calling method '.version_select at 0x7f351eb87160>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:04:52.852511 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-5973b269-dbc4-4e41-a3d8-b70f08cabe6d tempest-VolumesSnapshotsTestJSON-1060885163 tempest-VolumesSnapshotsTestJSON-1060885163-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/6753ce8a-a560-46e1-bf29-6dff8d7dde40" status: 200 len: 287 microversion: 2.1 time: 0.054214 Jul 21 20:04:52.853280 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 6/12] 10.222.0.58 () {58 vars in 1250 bytes} [Thu Jul 21 20:04:52 2022] GET /compute/v2.1/os-snapshots/6753ce8a-a560-46e1-bf29-6dff8d7dde40 => generated 287 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:04:53.864948 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-9e3acbf7-ca1d-4a81-b7c1-52b3fca9bd95 tempest-VolumesSnapshotsTestJSON-1060885163 tempest-VolumesSnapshotsTestJSON-1060885163-project] Calling method '.version_select at 0x7f351eb0b310>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:04:53.926607 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-9e3acbf7-ca1d-4a81-b7c1-52b3fca9bd95 tempest-VolumesSnapshotsTestJSON-1060885163 tempest-VolumesSnapshotsTestJSON-1060885163-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/6753ce8a-a560-46e1-bf29-6dff8d7dde40" status: 200 len: 287 microversion: 2.1 time: 0.066094 Jul 21 20:04:53.931467 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 7/13] 10.222.0.58 () {58 vars in 1250 bytes} [Thu Jul 21 20:04:53 2022] GET /compute/v2.1/os-snapshots/6753ce8a-a560-46e1-bf29-6dff8d7dde40 => generated 287 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:04:54.941707 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-799b0423-7dfb-4afd-aa94-a4fba9131b34 tempest-VolumesSnapshotsTestJSON-1060885163 tempest-VolumesSnapshotsTestJSON-1060885163-project] Calling method '.version_select at 0x7f351eb4bdc0>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:04:55.050459 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-799b0423-7dfb-4afd-aa94-a4fba9131b34 tempest-VolumesSnapshotsTestJSON-1060885163 tempest-VolumesSnapshotsTestJSON-1060885163-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/6753ce8a-a560-46e1-bf29-6dff8d7dde40" status: 200 len: 287 microversion: 2.1 time: 0.114404 Jul 21 20:04:55.051228 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 8/14] 10.222.0.58 () {58 vars in 1250 bytes} [Thu Jul 21 20:04:54 2022] GET /compute/v2.1/os-snapshots/6753ce8a-a560-46e1-bf29-6dff8d7dde40 => generated 287 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 20:04:55.272523 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-6f3366f7-45b8-4d07-b6b9-ab1b9f810ab3 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Action: 'create', calling method: .version_select at 0x7f351eb87a60>, body: {"keypair": {"name": "tempest-keypair-610516389", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE/6wdOmuVez2/iXjLofjXCG4FIwHHci/ZL2gU6nI9Obik1T+yIx/Sqo+fuKVQb2Vh2cxbdU6QO/ZTupWuaaJEn1zSbyvfXevSJE9/LHcTjJxZSFfMJz75nFynmgG8nNzA=="}} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:04:55.363910 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.quota [None req-6f3366f7-45b8-4d07-b6b9-ab1b9f810ab3 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Getting quotas for project f8ece8b465c04d33998002f8d880d556. Resources: {'key_pairs'} {{(pid=118345) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 20:04:55.376250 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.quota [None req-6f3366f7-45b8-4d07-b6b9-ab1b9f810ab3 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Getting quotas for user 02a93000972547d08f11f7ed23264d31 and project f8ece8b465c04d33998002f8d880d556. Resources: {'key_pairs'} {{(pid=118345) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 20:04:55.544645 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-6f3366f7-45b8-4d07-b6b9-ab1b9f810ab3 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.629983 Jul 21 20:04:55.546763 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 7/15] 10.222.0.58 () {62 vars in 1199 bytes} [Thu Jul 21 20:04:54 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 633 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 21 20:04:56.062605 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-dc8ec57a-cb69-4f4c-86b6-f89d2c10b944 tempest-VolumesSnapshotsTestJSON-1060885163 tempest-VolumesSnapshotsTestJSON-1060885163-project] Calling method '.version_select at 0x7f351eb0b0d0>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:04:56.112981 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-dc8ec57a-cb69-4f4c-86b6-f89d2c10b944 tempest-VolumesSnapshotsTestJSON-1060885163 tempest-VolumesSnapshotsTestJSON-1060885163-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/6753ce8a-a560-46e1-bf29-6dff8d7dde40" status: 200 len: 288 microversion: 2.1 time: 0.054327 Jul 21 20:04:56.131328 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 9/16] 10.222.0.58 () {58 vars in 1250 bytes} [Thu Jul 21 20:04:56 2022] GET /compute/v2.1/os-snapshots/6753ce8a-a560-46e1-bf29-6dff8d7dde40 => generated 288 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:04:56.132198 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-cf4c2630-91e9-4de1-a188-24d7583ec0c2 tempest-VolumesSnapshotsTestJSON-1060885163 tempest-VolumesSnapshotsTestJSON-1060885163-project] Calling method '.version_select at 0x7f351eb54f70>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:04:56.396837 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-cf4c2630-91e9-4de1-a188-24d7583ec0c2 tempest-VolumesSnapshotsTestJSON-1060885163 tempest-VolumesSnapshotsTestJSON-1060885163-project] 10.222.0.58 "DELETE /compute/v2.1/os-snapshots/6753ce8a-a560-46e1-bf29-6dff8d7dde40" status: 202 len: 0 microversion: 2.1 time: 0.274948 Jul 21 20:04:56.406168 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-6d23498d-f3b3-47f3-b1e7-7387031e63ae tempest-VolumesSnapshotsTestJSON-1060885163 tempest-VolumesSnapshotsTestJSON-1060885163-project] Calling method '.version_select at 0x7f351eb0bdc0>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:04:56.410264 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 8/17] 10.222.0.58 () {58 vars in 1253 bytes} [Thu Jul 21 20:04:56 2022] DELETE /compute/v2.1/os-snapshots/6753ce8a-a560-46e1-bf29-6dff8d7dde40 => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 20:04:56.499117 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-6d23498d-f3b3-47f3-b1e7-7387031e63ae tempest-VolumesSnapshotsTestJSON-1060885163 tempest-VolumesSnapshotsTestJSON-1060885163-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/6753ce8a-a560-46e1-bf29-6dff8d7dde40" status: 200 len: 287 microversion: 2.1 time: 0.096898 Jul 21 20:04:56.503616 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 10/18] 10.222.0.58 () {58 vars in 1250 bytes} [Thu Jul 21 20:04:56 2022] GET /compute/v2.1/os-snapshots/6753ce8a-a560-46e1-bf29-6dff8d7dde40 => generated 287 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:04:57.511799 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-ee0c04e9-d216-4ceb-8af9-c1887e79918c tempest-VolumesSnapshotsTestJSON-1060885163 tempest-VolumesSnapshotsTestJSON-1060885163-project] Calling method '.version_select at 0x7f351eb0baf0>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:04:57.552201 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.wsgi [None req-ee0c04e9-d216-4ceb-8af9-c1887e79918c tempest-VolumesSnapshotsTestJSON-1060885163 tempest-VolumesSnapshotsTestJSON-1060885163-project] HTTP exception thrown: Snapshot 6753ce8a-a560-46e1-bf29-6dff8d7dde40 could not be found. Jul 21 20:04:57.571936 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-ee0c04e9-d216-4ceb-8af9-c1887e79918c tempest-VolumesSnapshotsTestJSON-1060885163 tempest-VolumesSnapshotsTestJSON-1060885163-project] Request method failure captured: Jul 21 20:04:57.571936 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: request: GET /compute/v2.1/os-snapshots/6753ce8a-a560-46e1-bf29-6dff8d7dde40 HTTP/1.1 Jul 21 20:04:57.571936 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Accept: application/json Jul 21 20:04:57.571936 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Accept-Encoding: identity Jul 21 20:04:57.571936 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Connection: close Jul 21 20:04:57.571936 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Content-Length: 0 Jul 21 20:04:57.571936 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Content-Type: application/json Jul 21 20:04:57.571936 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Host: 10.222.0.58 Jul 21 20:04:57.571936 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Openstack-System-Scope: None Jul 21 20:04:57.571936 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: User-Agent: python-urllib3/1.26.9 Jul 21 20:04:57.571936 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Auth-Token: gAAAAABi2bFZryNmVP3FqCY70-Lq0v_3SyXVxWm0gKakNWbHscKPTHEzEZTMUHlAgCYpZBN7zbK5i18xK8YRU3LBpWF49E14Kw-530KrotgqkbRsy3WbyMxRvjAFGBq3wmydsNriCwXXG-fuytu2or-wO-PY4i-w6HRgxDlVCumSbr5Wvtqb-zc Jul 21 20:04:57.571936 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Domain-Id: None Jul 21 20:04:57.571936 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Domain-Name: None Jul 21 20:04:57.571936 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Identity-Status: Confirmed Jul 21 20:04:57.571936 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Is-Admin-Project: True Jul 21 20:04:57.571936 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Domain-Id: default Jul 21 20:04:57.571936 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Domain-Name: Default Jul 21 20:04:57.571936 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Id: 8dd5e3e2b45a4862b0f7b32bd2bb6593 Jul 21 20:04:57.571936 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1060885163 Jul 21 20:04:57.571936 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Role: reader,member Jul 21 20:04:57.571936 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Roles: reader,member Jul 21 20:04:57.573499 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8dd5e3e2b45a4862b0f7b32bd2bb6593"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8dd5e3e2b45a4862b0f7b32bd2bb6593"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8dd5e3e2b45a4862b0f7b32bd2bb6593"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8dd5e3e2b45a4862b0f7b32bd2bb6593"}]}] Jul 21 20:04:57.573499 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1060885163 Jul 21 20:04:57.573499 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Tenant-Id: 8dd5e3e2b45a4862b0f7b32bd2bb6593 Jul 21 20:04:57.573499 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1060885163 Jul 21 20:04:57.573499 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User: tempest-VolumesSnapshotsTestJSON-1060885163-project Jul 21 20:04:57.573499 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Domain-Id: default Jul 21 20:04:57.573499 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Domain-Name: Default Jul 21 20:04:57.573499 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Id: 38cb8ba206034d74afcf12be694018c9 Jul 21 20:04:57.573499 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1060885163-project Jul 21 20:04:57.573499 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: method: Jul 21 20:04:57.573499 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: exception: Snapshot 6753ce8a-a560-46e1-bf29-6dff8d7dde40 could not be found. Jul 21 20:04:57.573499 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: action_args: {'id': '6753ce8a-a560-46e1-bf29-6dff8d7dde40'} Jul 21 20:04:57.573499 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 20:04:57.574436 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:04:57.574436 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 21 20:04:57.574436 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 21 20:04:57.574436 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 21 20:04:57.574436 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 21 20:04:57.574436 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 21 20:04:57.574436 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 21 20:04:57.574436 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 20:04:57.574436 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 20:04:57.574436 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 20:04:57.574436 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 20:04:57.574436 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 20:04:57.574436 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 20:04:57.574436 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 20:04:57.574436 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 20:04:57.574436 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 6753ce8a-a560-46e1-bf29-6dff8d7dde40 could not be found. (HTTP 404) (Request-ID: req-fc6349d4-9067-4f49-b893-921818f0b55e) Jul 21 20:04:57.574436 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:04:57.574436 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:04:57.576256 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:04:57.576256 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:04:57.576256 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 21 20:04:57.576256 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 21 20:04:57.576256 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 20:04:57.576256 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 20:04:57.576256 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 21 20:04:57.576256 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 21 20:04:57.576256 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 20:04:57.576256 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 20:04:57.576256 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 21 20:04:57.576256 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 21 20:04:57.576256 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 21 20:04:57.576256 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 21 20:04:57.576256 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 21 20:04:57.576256 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 21 20:04:57.576256 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 20:04:57.576256 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 20:04:57.576256 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 20:04:57.577699 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 20:04:57.577699 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 20:04:57.577699 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 20:04:57.577699 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 20:04:57.577699 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 20:04:57.577699 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 6753ce8a-a560-46e1-bf29-6dff8d7dde40 could not be found. Jul 21 20:04:57.577699 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:04:57.577699 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:04:57.577699 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:04:57.577699 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:04:57.577699 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:04:57.577699 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:04:57.577699 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 20:04:57.577699 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 20:04:57.577699 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 20:04:57.577699 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 20:04:57.577699 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 20:04:57.577699 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 20:04:57.577699 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 21 20:04:57.577699 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 20:04:57.578905 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 6753ce8a-a560-46e1-bf29-6dff8d7dde40 could not be found. Jul 21 20:04:57.578905 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:04:57.578905 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:04:57.578905 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:04:57.578905 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:04:57.578905 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:04:57.578905 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:04:57.578905 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 20:04:57.578905 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 20:04:57.578905 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 6753ce8a-a560-46e1-bf29-6dff8d7dde40 could not be found. Jul 21 20:04:57.578905 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:04:57.578905 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-ee0c04e9-d216-4ceb-8af9-c1887e79918c tempest-VolumesSnapshotsTestJSON-1060885163 tempest-VolumesSnapshotsTestJSON-1060885163-project] Returning 404 to user: Snapshot 6753ce8a-a560-46e1-bf29-6dff8d7dde40 could not be found. {{(pid=118344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 20:04:57.578905 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-ee0c04e9-d216-4ceb-8af9-c1887e79918c tempest-VolumesSnapshotsTestJSON-1060885163 tempest-VolumesSnapshotsTestJSON-1060885163-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/6753ce8a-a560-46e1-bf29-6dff8d7dde40" status: 404 len: 111 microversion: 2.1 time: 0.067594 Jul 21 20:04:57.581117 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 11/19] 10.222.0.58 () {58 vars in 1250 bytes} [Thu Jul 21 20:04:57 2022] GET /compute/v2.1/os-snapshots/6753ce8a-a560-46e1-bf29-6dff8d7dde40 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 20:04:57.610251 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-b7fd3e83-b708-4c68-9ffa-22d622fe657b tempest-VolumesSnapshotsTestJSON-1060885163 tempest-VolumesSnapshotsTestJSON-1060885163-project] Calling method '.version_select at 0x7f351f502040>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:04:57.716683 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-08e59b1e-9444-4ba6-be67-c56a5d2e9e92 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-493438512", "imageRef": "357a1479-6cbd-4882-8d3f-d945fa40e6df", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:04:57.938992 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-b7fd3e83-b708-4c68-9ffa-22d622fe657b tempest-VolumesSnapshotsTestJSON-1060885163 tempest-VolumesSnapshotsTestJSON-1060885163-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/cda54436-5fb1-4d4f-8c93-f365f35e9fbf" status: 202 len: 0 microversion: 2.1 time: 0.351349 Jul 21 20:04:57.938992 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 12/20] 10.222.0.58 () {58 vars in 1247 bytes} [Thu Jul 21 20:04:57 2022] DELETE /compute/v2.1/os-volumes/cda54436-5fb1-4d4f-8c93-f365f35e9fbf => generated 0 bytes in 353 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 20:04:57.941935 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.network.neutron [None req-08e59b1e-9444-4ba6-be67-c56a5d2e9e92 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] validate_networks() for [('2a12064c-8c8d-4cc4-bf6b-339810e78e0e', None, None, None, None, None)] {{(pid=118345) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 20:04:57.947662 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-46359846-a686-4ddd-9f41-f4a69c3783b3 tempest-VolumesSnapshotsTestJSON-1060885163 tempest-VolumesSnapshotsTestJSON-1060885163-project] Calling method '.version_select at 0x7f351e257940>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:04:58.059991 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-46359846-a686-4ddd-9f41-f4a69c3783b3 tempest-VolumesSnapshotsTestJSON-1060885163 tempest-VolumesSnapshotsTestJSON-1060885163-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/cda54436-5fb1-4d4f-8c93-f365f35e9fbf" status: 200 len: 345 microversion: 2.1 time: 0.116374 Jul 21 20:04:58.061317 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 13/21] 10.222.0.58 () {58 vars in 1244 bytes} [Thu Jul 21 20:04:57 2022] GET /compute/v2.1/os-volumes/cda54436-5fb1-4d4f-8c93-f365f35e9fbf => generated 345 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:04:58.632005 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-f7ac181a-aa53-46af-824c-2ff528ee336a tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Action: 'create', calling method: .version_select at 0x7f351e257f70>, body: {"keypair": {"name": "tempest-keypair-653216594", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ6nF5kYhhmbS6SkNzn5R+aQOezvS1/TNM47JrXDRbXu68fsuHNBMa/pSWMiE1/AnXqQtfJ4jl7zBcohCtbLpxkDbTS31KoeVtmwk2RJyqnYU1V1ippAmrvxbrUPcJnzgg=="}} {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:04:58.653495 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.quota [None req-f7ac181a-aa53-46af-824c-2ff528ee336a tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Getting quotas for project f5e462e9247c4feab7e498186a547728. Resources: {'key_pairs'} {{(pid=118344) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 20:04:58.657995 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.quota [None req-f7ac181a-aa53-46af-824c-2ff528ee336a tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Getting quotas for user 44f668466fa542039e88b4fc7714de81 and project f5e462e9247c4feab7e498186a547728. Resources: {'key_pairs'} {{(pid=118344) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 20:04:58.856105 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-f7ac181a-aa53-46af-824c-2ff528ee336a tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.314234 Jul 21 20:04:58.861206 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 14/22] 10.222.0.58 () {60 vars in 1158 bytes} [Thu Jul 21 20:04:58 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:04:59.073758 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-a1295667-0c37-4d87-93f7-2c3cc7eb34b3 tempest-VolumesSnapshotsTestJSON-1060885163 tempest-VolumesSnapshotsTestJSON-1060885163-project] Calling method '.version_select at 0x7f351e27d280>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:04:59.156022 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-a1295667-0c37-4d87-93f7-2c3cc7eb34b3 tempest-VolumesSnapshotsTestJSON-1060885163 tempest-VolumesSnapshotsTestJSON-1060885163-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/cda54436-5fb1-4d4f-8c93-f365f35e9fbf" status: 200 len: 345 microversion: 2.1 time: 0.077101 Jul 21 20:04:59.156022 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 15/23] 10.222.0.58 () {58 vars in 1244 bytes} [Thu Jul 21 20:04:59 2022] GET /compute/v2.1/os-volumes/cda54436-5fb1-4d4f-8c93-f365f35e9fbf => generated 345 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 20:04:59.502824 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-64192229-1d91-45a6-b179-89bdefb70fca tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-270742351", "imageRef": "357a1479-6cbd-4882-8d3f-d945fa40e6df", "flavorRef": "452", "networks": [{"uuid": "2b792c35-a6dd-48b5-b2be-a6325040342d"}]}} {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:04:59.712648 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.network.neutron [None req-64192229-1d91-45a6-b179-89bdefb70fca tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] validate_networks() for [('2b792c35-a6dd-48b5-b2be-a6325040342d', None, None, None, None, None)] {{(pid=118344) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 20:04:59.818916 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-08e59b1e-9444-4ba6-be67-c56a5d2e9e92 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Flavor limits 0:0:0 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 20:04:59.819894 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-08e59b1e-9444-4ba6-be67-c56a5d2e9e92 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Image limits 0:0:0 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 20:04:59.820546 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-08e59b1e-9444-4ba6-be67-c56a5d2e9e92 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Flavor pref 0:0:0 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 20:04:59.821096 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-08e59b1e-9444-4ba6-be67-c56a5d2e9e92 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Image pref 0:0:0 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 20:04:59.821654 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-08e59b1e-9444-4ba6-be67-c56a5d2e9e92 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 20:04:59.851926 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-08e59b1e-9444-4ba6-be67-c56a5d2e9e92 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:04:59.852515 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-08e59b1e-9444-4ba6-be67-c56a5d2e9e92 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:04:59.853933 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-08e59b1e-9444-4ba6-be67-c56a5d2e9e92 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:04:59.854481 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-08e59b1e-9444-4ba6-be67-c56a5d2e9e92 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:04:59.888238 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.quota [None req-08e59b1e-9444-4ba6-be67-c56a5d2e9e92 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Getting quotas for project 6d4acf1287ad4dac9bbf6dc27f427a7c. Resources: {'instances', 'cores', 'ram'} {{(pid=118345) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 20:04:59.939652 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.quota [None req-08e59b1e-9444-4ba6-be67-c56a5d2e9e92 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Getting quotas for user df9139f72d004b2fac1cba17647c129d and project 6d4acf1287ad4dac9bbf6dc27f427a7c. Resources: {'instances', 'cores', 'ram'} {{(pid=118345) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 20:04:59.970076 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-08e59b1e-9444-4ba6-be67-c56a5d2e9e92 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Going to run 1 instances... {{(pid=118345) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 20:04:59.977899 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-08e59b1e-9444-4ba6-be67-c56a5d2e9e92 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 3a615f10-936f-48d1-aad9-e414dc31d016] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='357a1479-6cbd-4882-8d3f-d945fa40e6df',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118345) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 20:05:00.241819 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-08e59b1e-9444-4ba6-be67-c56a5d2e9e92 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.942607 Jul 21 20:05:00.248125 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 9/24] 10.222.0.58 () {60 vars in 1146 bytes} [Thu Jul 21 20:04:57 2022] POST /compute/v2.1/servers => generated 383 bytes in 2944 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 20:05:00.256027 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-96e246a1-59e4-4862-baf8-ce618d7763fb tempest-VolumesSnapshotsTestJSON-1060885163 tempest-VolumesSnapshotsTestJSON-1060885163-project] Calling method '.version_select at 0x7f351e225ca0>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:00.318706 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.wsgi [None req-96e246a1-59e4-4862-baf8-ce618d7763fb tempest-VolumesSnapshotsTestJSON-1060885163 tempest-VolumesSnapshotsTestJSON-1060885163-project] HTTP exception thrown: Volume cda54436-5fb1-4d4f-8c93-f365f35e9fbf could not be found. Jul 21 20:05:00.325010 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-96e246a1-59e4-4862-baf8-ce618d7763fb tempest-VolumesSnapshotsTestJSON-1060885163 tempest-VolumesSnapshotsTestJSON-1060885163-project] Request method failure captured: Jul 21 20:05:00.325010 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: request: GET /compute/v2.1/os-volumes/cda54436-5fb1-4d4f-8c93-f365f35e9fbf HTTP/1.1 Jul 21 20:05:00.325010 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Accept: application/json Jul 21 20:05:00.325010 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Accept-Encoding: identity Jul 21 20:05:00.325010 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Connection: close Jul 21 20:05:00.325010 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Content-Length: 0 Jul 21 20:05:00.325010 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Content-Type: application/json Jul 21 20:05:00.325010 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Host: 10.222.0.58 Jul 21 20:05:00.325010 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Openstack-System-Scope: None Jul 21 20:05:00.325010 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: User-Agent: python-urllib3/1.26.9 Jul 21 20:05:00.325010 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Auth-Token: gAAAAABi2bFZryNmVP3FqCY70-Lq0v_3SyXVxWm0gKakNWbHscKPTHEzEZTMUHlAgCYpZBN7zbK5i18xK8YRU3LBpWF49E14Kw-530KrotgqkbRsy3WbyMxRvjAFGBq3wmydsNriCwXXG-fuytu2or-wO-PY4i-w6HRgxDlVCumSbr5Wvtqb-zc Jul 21 20:05:00.325010 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Domain-Id: None Jul 21 20:05:00.325010 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Domain-Name: None Jul 21 20:05:00.325010 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Identity-Status: Confirmed Jul 21 20:05:00.325010 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Is-Admin-Project: True Jul 21 20:05:00.325010 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Id: default Jul 21 20:05:00.325010 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Name: Default Jul 21 20:05:00.325010 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Id: 8dd5e3e2b45a4862b0f7b32bd2bb6593 Jul 21 20:05:00.325010 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1060885163 Jul 21 20:05:00.325010 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Role: reader,member Jul 21 20:05:00.325010 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Roles: reader,member Jul 21 20:05:00.326048 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8dd5e3e2b45a4862b0f7b32bd2bb6593"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8dd5e3e2b45a4862b0f7b32bd2bb6593"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8dd5e3e2b45a4862b0f7b32bd2bb6593"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8dd5e3e2b45a4862b0f7b32bd2bb6593"}]}] Jul 21 20:05:00.326048 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1060885163 Jul 21 20:05:00.326048 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Tenant-Id: 8dd5e3e2b45a4862b0f7b32bd2bb6593 Jul 21 20:05:00.326048 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1060885163 Jul 21 20:05:00.326048 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User: tempest-VolumesSnapshotsTestJSON-1060885163-project Jul 21 20:05:00.326048 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Id: default Jul 21 20:05:00.326048 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Name: Default Jul 21 20:05:00.326048 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Id: 38cb8ba206034d74afcf12be694018c9 Jul 21 20:05:00.326048 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1060885163-project Jul 21 20:05:00.326048 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: method: Jul 21 20:05:00.326048 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: exception: Volume cda54436-5fb1-4d4f-8c93-f365f35e9fbf could not be found. Jul 21 20:05:00.326048 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: action_args: {'id': 'cda54436-5fb1-4d4f-8c93-f365f35e9fbf'} Jul 21 20:05:00.326048 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 20:05:00.326870 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:05:00.326870 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 20:05:00.326870 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 20:05:00.326870 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 21 20:05:00.326870 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 21 20:05:00.326870 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 21 20:05:00.326870 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 21 20:05:00.326870 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 20:05:00.326870 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 20:05:00.326870 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 20:05:00.326870 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 20:05:00.326870 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 20:05:00.326870 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 20:05:00.326870 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 20:05:00.326870 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 20:05:00.326870 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cda54436-5fb1-4d4f-8c93-f365f35e9fbf could not be found. (HTTP 404) (Request-ID: req-6f9f044b-b723-43d1-b903-2db953f6cbd7) Jul 21 20:05:00.326870 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:05:00.326870 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:05:00.326870 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:05:00.327875 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:05:00.327875 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 21 20:05:00.327875 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 21 20:05:00.327875 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 20:05:00.327875 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 20:05:00.327875 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 21 20:05:00.327875 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 21 20:05:00.327875 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 20:05:00.327875 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 20:05:00.327875 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 20:05:00.327875 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 20:05:00.327875 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 21 20:05:00.327875 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 21 20:05:00.327875 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 21 20:05:00.327875 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 21 20:05:00.327875 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 20:05:00.327875 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 20:05:00.327875 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 20:05:00.327875 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 20:05:00.328808 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 20:05:00.328808 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 20:05:00.328808 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 20:05:00.328808 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 20:05:00.328808 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cda54436-5fb1-4d4f-8c93-f365f35e9fbf could not be found. Jul 21 20:05:00.328808 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:05:00.328808 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:05:00.328808 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:05:00.328808 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:05:00.328808 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:05:00.328808 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:05:00.328808 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 20:05:00.328808 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 20:05:00.328808 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 20:05:00.328808 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 20:05:00.328808 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 20:05:00.328808 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 20:05:00.328808 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 21 20:05:00.328808 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 20:05:00.329761 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume cda54436-5fb1-4d4f-8c93-f365f35e9fbf could not be found. Jul 21 20:05:00.329761 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:05:00.329761 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:05:00.329761 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:05:00.329761 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:05:00.329761 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:05:00.329761 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:05:00.329761 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 20:05:00.329761 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 20:05:00.329761 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cda54436-5fb1-4d4f-8c93-f365f35e9fbf could not be found. Jul 21 20:05:00.329761 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:05:00.329761 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-96e246a1-59e4-4862-baf8-ce618d7763fb tempest-VolumesSnapshotsTestJSON-1060885163 tempest-VolumesSnapshotsTestJSON-1060885163-project] Returning 404 to user: Volume cda54436-5fb1-4d4f-8c93-f365f35e9fbf could not be found. {{(pid=118345) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 20:05:00.329761 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-96e246a1-59e4-4862-baf8-ce618d7763fb tempest-VolumesSnapshotsTestJSON-1060885163 tempest-VolumesSnapshotsTestJSON-1060885163-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/cda54436-5fb1-4d4f-8c93-f365f35e9fbf" status: 404 len: 109 microversion: 2.1 time: 0.082391 Jul 21 20:05:00.330988 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 10/25] 10.222.0.58 () {58 vars in 1244 bytes} [Thu Jul 21 20:05:00 2022] GET /compute/v2.1/os-volumes/cda54436-5fb1-4d4f-8c93-f365f35e9fbf => generated 109 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 20:05:00.346014 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-5c9615a1-3970-45b1-8466-a81f7c293c34 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:00.348201 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-5c9615a1-3970-45b1-8466-a81f7c293c34 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 3a615f10-936f-48d1-aad9-e414dc31d016] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:00.755907 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-5c9615a1-3970-45b1-8466-a81f7c293c34 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:00.824156 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-5c9615a1-3970-45b1-8466-a81f7c293c34 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/3a615f10-936f-48d1-aad9-e414dc31d016" status: 200 len: 1221 microversion: 2.1 time: 0.490660 Jul 21 20:05:00.826513 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 11/26] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:00 2022] GET /compute/v2.1/servers/3a615f10-936f-48d1-aad9-e414dc31d016 => generated 1221 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:00.855585 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-4c6d9fa0-b838-46ef-a6b7-5d2e5f06687f tempest-VolumesSnapshotsTestJSON-1060885163 tempest-VolumesSnapshotsTestJSON-1060885163-project] Calling method '.version_select at 0x7f351f502040>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:00.951291 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.wsgi [None req-4c6d9fa0-b838-46ef-a6b7-5d2e5f06687f tempest-VolumesSnapshotsTestJSON-1060885163 tempest-VolumesSnapshotsTestJSON-1060885163-project] HTTP exception thrown: Volume cda54436-5fb1-4d4f-8c93-f365f35e9fbf could not be found. Jul 21 20:05:00.953863 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-4c6d9fa0-b838-46ef-a6b7-5d2e5f06687f tempest-VolumesSnapshotsTestJSON-1060885163 tempest-VolumesSnapshotsTestJSON-1060885163-project] Request method failure captured: Jul 21 20:05:00.953863 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: request: DELETE /compute/v2.1/os-volumes/cda54436-5fb1-4d4f-8c93-f365f35e9fbf HTTP/1.1 Jul 21 20:05:00.953863 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Accept: application/json Jul 21 20:05:00.953863 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Accept-Encoding: identity Jul 21 20:05:00.953863 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Connection: close Jul 21 20:05:00.953863 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Content-Length: 0 Jul 21 20:05:00.953863 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Content-Type: application/json Jul 21 20:05:00.953863 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Host: 10.222.0.58 Jul 21 20:05:00.953863 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Openstack-System-Scope: None Jul 21 20:05:00.953863 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: User-Agent: python-urllib3/1.26.9 Jul 21 20:05:00.953863 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Auth-Token: gAAAAABi2bFZryNmVP3FqCY70-Lq0v_3SyXVxWm0gKakNWbHscKPTHEzEZTMUHlAgCYpZBN7zbK5i18xK8YRU3LBpWF49E14Kw-530KrotgqkbRsy3WbyMxRvjAFGBq3wmydsNriCwXXG-fuytu2or-wO-PY4i-w6HRgxDlVCumSbr5Wvtqb-zc Jul 21 20:05:00.953863 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Domain-Id: None Jul 21 20:05:00.953863 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Domain-Name: None Jul 21 20:05:00.953863 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Identity-Status: Confirmed Jul 21 20:05:00.953863 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Is-Admin-Project: True Jul 21 20:05:00.953863 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Id: default Jul 21 20:05:00.953863 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Name: Default Jul 21 20:05:00.953863 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Id: 8dd5e3e2b45a4862b0f7b32bd2bb6593 Jul 21 20:05:00.953863 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1060885163 Jul 21 20:05:00.953863 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Role: reader,member Jul 21 20:05:00.953863 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Roles: reader,member Jul 21 20:05:00.955334 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8dd5e3e2b45a4862b0f7b32bd2bb6593"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8dd5e3e2b45a4862b0f7b32bd2bb6593"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8dd5e3e2b45a4862b0f7b32bd2bb6593"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8dd5e3e2b45a4862b0f7b32bd2bb6593"}]}] Jul 21 20:05:00.955334 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1060885163 Jul 21 20:05:00.955334 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Tenant-Id: 8dd5e3e2b45a4862b0f7b32bd2bb6593 Jul 21 20:05:00.955334 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1060885163 Jul 21 20:05:00.955334 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User: tempest-VolumesSnapshotsTestJSON-1060885163-project Jul 21 20:05:00.955334 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Id: default Jul 21 20:05:00.955334 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Name: Default Jul 21 20:05:00.955334 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Id: 38cb8ba206034d74afcf12be694018c9 Jul 21 20:05:00.955334 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1060885163-project Jul 21 20:05:00.955334 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: method: Jul 21 20:05:00.955334 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: exception: Volume cda54436-5fb1-4d4f-8c93-f365f35e9fbf could not be found. Jul 21 20:05:00.955334 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: action_args: {'id': 'cda54436-5fb1-4d4f-8c93-f365f35e9fbf'} Jul 21 20:05:00.955334 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 20:05:00.956107 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:05:00.956107 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 20:05:00.956107 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 20:05:00.956107 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 21 20:05:00.956107 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 21 20:05:00.956107 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 21 20:05:00.956107 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 21 20:05:00.956107 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 21 20:05:00.956107 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 21 20:05:00.956107 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 21 20:05:00.956107 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 21 20:05:00.956107 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 20:05:00.956107 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 20:05:00.956107 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 20:05:00.956107 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 20:05:00.956107 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cda54436-5fb1-4d4f-8c93-f365f35e9fbf could not be found. (HTTP 404) (Request-ID: req-b61eb9cf-43ef-4cb7-9839-3ca4f3921891) Jul 21 20:05:00.956107 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:05:00.956107 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:05:00.956107 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:05:00.957294 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:05:00.957294 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 21 20:05:00.957294 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 21 20:05:00.957294 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 20:05:00.957294 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 20:05:00.957294 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 21 20:05:00.957294 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 21 20:05:00.957294 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 20:05:00.957294 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 20:05:00.957294 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 20:05:00.957294 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 20:05:00.957294 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 21 20:05:00.957294 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 21 20:05:00.957294 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 21 20:05:00.957294 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 21 20:05:00.957294 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 21 20:05:00.957294 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 21 20:05:00.957294 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 21 20:05:00.957294 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 21 20:05:00.958559 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 20:05:00.958559 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 20:05:00.958559 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 20:05:00.958559 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 20:05:00.958559 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cda54436-5fb1-4d4f-8c93-f365f35e9fbf could not be found. Jul 21 20:05:00.958559 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:05:00.958559 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:05:00.958559 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:05:00.958559 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:05:00.958559 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:05:00.958559 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:05:00.958559 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 20:05:00.958559 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 20:05:00.958559 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 20:05:00.958559 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 20:05:00.958559 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 20:05:00.958559 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 20:05:00.958559 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 21 20:05:00.958559 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 20:05:00.965705 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume cda54436-5fb1-4d4f-8c93-f365f35e9fbf could not be found. Jul 21 20:05:00.965705 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:05:00.965705 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:05:00.965705 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:05:00.965705 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:05:00.965705 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:05:00.965705 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:05:00.965705 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 20:05:00.965705 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 20:05:00.965705 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cda54436-5fb1-4d4f-8c93-f365f35e9fbf could not be found. Jul 21 20:05:00.965705 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:05:00.965705 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-4c6d9fa0-b838-46ef-a6b7-5d2e5f06687f tempest-VolumesSnapshotsTestJSON-1060885163 tempest-VolumesSnapshotsTestJSON-1060885163-project] Returning 404 to user: Volume cda54436-5fb1-4d4f-8c93-f365f35e9fbf could not be found. {{(pid=118345) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 20:05:00.965705 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-4c6d9fa0-b838-46ef-a6b7-5d2e5f06687f tempest-VolumesSnapshotsTestJSON-1060885163 tempest-VolumesSnapshotsTestJSON-1060885163-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/cda54436-5fb1-4d4f-8c93-f365f35e9fbf" status: 404 len: 109 microversion: 2.1 time: 0.133454 Jul 21 20:05:00.965705 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 12/27] 10.222.0.58 () {58 vars in 1247 bytes} [Thu Jul 21 20:05:00 2022] DELETE /compute/v2.1/os-volumes/cda54436-5fb1-4d4f-8c93-f365f35e9fbf => generated 109 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 20:05:00.994551 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-cddc2290-49e7-4d02-94cf-7333db344b25 tempest-VolumesSnapshotsTestJSON-1060885163 tempest-VolumesSnapshotsTestJSON-1060885163-project] Calling method '.version_select at 0x7f351d1ce820>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:01.076329 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.wsgi [None req-cddc2290-49e7-4d02-94cf-7333db344b25 tempest-VolumesSnapshotsTestJSON-1060885163 tempest-VolumesSnapshotsTestJSON-1060885163-project] HTTP exception thrown: Volume cda54436-5fb1-4d4f-8c93-f365f35e9fbf could not be found. Jul 21 20:05:01.079227 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-cddc2290-49e7-4d02-94cf-7333db344b25 tempest-VolumesSnapshotsTestJSON-1060885163 tempest-VolumesSnapshotsTestJSON-1060885163-project] Request method failure captured: Jul 21 20:05:01.079227 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: request: GET /compute/v2.1/os-volumes/cda54436-5fb1-4d4f-8c93-f365f35e9fbf HTTP/1.1 Jul 21 20:05:01.079227 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Accept: application/json Jul 21 20:05:01.079227 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Accept-Encoding: identity Jul 21 20:05:01.079227 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Connection: close Jul 21 20:05:01.079227 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Content-Length: 0 Jul 21 20:05:01.079227 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Content-Type: application/json Jul 21 20:05:01.079227 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Host: 10.222.0.58 Jul 21 20:05:01.079227 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Openstack-System-Scope: None Jul 21 20:05:01.079227 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: User-Agent: python-urllib3/1.26.9 Jul 21 20:05:01.079227 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Auth-Token: gAAAAABi2bFZryNmVP3FqCY70-Lq0v_3SyXVxWm0gKakNWbHscKPTHEzEZTMUHlAgCYpZBN7zbK5i18xK8YRU3LBpWF49E14Kw-530KrotgqkbRsy3WbyMxRvjAFGBq3wmydsNriCwXXG-fuytu2or-wO-PY4i-w6HRgxDlVCumSbr5Wvtqb-zc Jul 21 20:05:01.079227 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Domain-Id: None Jul 21 20:05:01.079227 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Domain-Name: None Jul 21 20:05:01.079227 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Identity-Status: Confirmed Jul 21 20:05:01.079227 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Is-Admin-Project: True Jul 21 20:05:01.079227 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Id: default Jul 21 20:05:01.079227 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Name: Default Jul 21 20:05:01.079227 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Id: 8dd5e3e2b45a4862b0f7b32bd2bb6593 Jul 21 20:05:01.079227 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1060885163 Jul 21 20:05:01.079227 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Role: reader,member Jul 21 20:05:01.079227 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Roles: reader,member Jul 21 20:05:01.080441 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8dd5e3e2b45a4862b0f7b32bd2bb6593"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8dd5e3e2b45a4862b0f7b32bd2bb6593"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8dd5e3e2b45a4862b0f7b32bd2bb6593"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8dd5e3e2b45a4862b0f7b32bd2bb6593"}]}] Jul 21 20:05:01.080441 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1060885163 Jul 21 20:05:01.080441 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Tenant-Id: 8dd5e3e2b45a4862b0f7b32bd2bb6593 Jul 21 20:05:01.080441 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1060885163 Jul 21 20:05:01.080441 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User: tempest-VolumesSnapshotsTestJSON-1060885163-project Jul 21 20:05:01.080441 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Id: default Jul 21 20:05:01.080441 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Name: Default Jul 21 20:05:01.080441 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Id: 38cb8ba206034d74afcf12be694018c9 Jul 21 20:05:01.080441 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1060885163-project Jul 21 20:05:01.080441 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: method: Jul 21 20:05:01.080441 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: exception: Volume cda54436-5fb1-4d4f-8c93-f365f35e9fbf could not be found. Jul 21 20:05:01.080441 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: action_args: {'id': 'cda54436-5fb1-4d4f-8c93-f365f35e9fbf'} Jul 21 20:05:01.080441 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 20:05:01.081153 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:05:01.081153 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 20:05:01.081153 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 20:05:01.081153 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 21 20:05:01.081153 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 21 20:05:01.081153 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 21 20:05:01.081153 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 21 20:05:01.081153 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 20:05:01.081153 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 20:05:01.081153 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 20:05:01.081153 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 20:05:01.081153 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 20:05:01.081153 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 20:05:01.081153 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 20:05:01.081153 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 20:05:01.081153 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cda54436-5fb1-4d4f-8c93-f365f35e9fbf could not be found. (HTTP 404) (Request-ID: req-a596c6c6-87fe-40c0-8f4c-abe6191c0f7e) Jul 21 20:05:01.081153 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:05:01.081153 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:05:01.081153 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:05:01.082163 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:05:01.082163 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 21 20:05:01.082163 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 21 20:05:01.082163 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 20:05:01.082163 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 20:05:01.082163 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 21 20:05:01.082163 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 21 20:05:01.082163 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 20:05:01.082163 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 20:05:01.082163 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 20:05:01.082163 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 20:05:01.082163 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 21 20:05:01.082163 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 21 20:05:01.082163 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 21 20:05:01.082163 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 21 20:05:01.082163 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 20:05:01.082163 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 20:05:01.082163 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 20:05:01.082163 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 20:05:01.089457 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 20:05:01.089457 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 20:05:01.089457 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 20:05:01.089457 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 20:05:01.089457 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cda54436-5fb1-4d4f-8c93-f365f35e9fbf could not be found. Jul 21 20:05:01.089457 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:05:01.089457 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:05:01.089457 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:05:01.089457 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:05:01.089457 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:05:01.089457 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:05:01.089457 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 20:05:01.089457 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 20:05:01.089457 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 20:05:01.089457 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 20:05:01.089457 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 20:05:01.089457 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 20:05:01.089457 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 21 20:05:01.089457 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 20:05:01.090457 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume cda54436-5fb1-4d4f-8c93-f365f35e9fbf could not be found. Jul 21 20:05:01.090457 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:05:01.090457 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:05:01.090457 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:05:01.090457 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:05:01.090457 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:05:01.090457 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:05:01.090457 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 20:05:01.090457 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 20:05:01.090457 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cda54436-5fb1-4d4f-8c93-f365f35e9fbf could not be found. Jul 21 20:05:01.090457 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:05:01.090457 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-cddc2290-49e7-4d02-94cf-7333db344b25 tempest-VolumesSnapshotsTestJSON-1060885163 tempest-VolumesSnapshotsTestJSON-1060885163-project] Returning 404 to user: Volume cda54436-5fb1-4d4f-8c93-f365f35e9fbf could not be found. {{(pid=118345) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 20:05:01.090457 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-cddc2290-49e7-4d02-94cf-7333db344b25 tempest-VolumesSnapshotsTestJSON-1060885163 tempest-VolumesSnapshotsTestJSON-1060885163-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/cda54436-5fb1-4d4f-8c93-f365f35e9fbf" status: 404 len: 109 microversion: 2.1 time: 0.118330 Jul 21 20:05:01.090457 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 13/28] 10.222.0.58 () {58 vars in 1244 bytes} [Thu Jul 21 20:05:00 2022] GET /compute/v2.1/os-volumes/cda54436-5fb1-4d4f-8c93-f365f35e9fbf => generated 109 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 20:05:01.236076 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-91aecac0-eec0-4a27-b26e-19c548f0598d tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-451621682", "imageRef": "357a1479-6cbd-4882-8d3f-d945fa40e6df", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:05:01.381494 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.network.neutron [None req-91aecac0-eec0-4a27-b26e-19c548f0598d tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] validate_networks() for [('2a12064c-8c8d-4cc4-bf6b-339810e78e0e', None, None, None, None, None)] {{(pid=118345) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 20:05:02.372112 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.virt.hardware [None req-64192229-1d91-45a6-b179-89bdefb70fca tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Flavor limits 0:0:0 {{(pid=118344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 20:05:02.373696 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.virt.hardware [None req-64192229-1d91-45a6-b179-89bdefb70fca tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Image limits 0:0:0 {{(pid=118344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 20:05:02.374323 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.virt.hardware [None req-64192229-1d91-45a6-b179-89bdefb70fca tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Flavor pref 0:0:0 {{(pid=118344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 20:05:02.374879 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.virt.hardware [None req-64192229-1d91-45a6-b179-89bdefb70fca tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Image pref 0:0:0 {{(pid=118344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 20:05:02.375475 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.virt.hardware [None req-64192229-1d91-45a6-b179-89bdefb70fca tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 20:05:02.397408 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-64192229-1d91-45a6-b179-89bdefb70fca tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:02.400217 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-64192229-1d91-45a6-b179-89bdefb70fca tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:02.401329 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-64192229-1d91-45a6-b179-89bdefb70fca tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:02.402488 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-64192229-1d91-45a6-b179-89bdefb70fca tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:02.473092 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.quota [None req-64192229-1d91-45a6-b179-89bdefb70fca tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Getting quotas for project fc40ec656240410e862fde9531e0fc55. Resources: {'instances', 'cores', 'ram'} {{(pid=118344) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 20:05:02.508270 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.quota [None req-64192229-1d91-45a6-b179-89bdefb70fca tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Getting quotas for user 0100323b16c045b98dec585b9e59f077 and project fc40ec656240410e862fde9531e0fc55. Resources: {'instances', 'cores', 'ram'} {{(pid=118344) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 20:05:02.547810 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-64192229-1d91-45a6-b179-89bdefb70fca tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Going to run 1 instances... {{(pid=118344) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 20:05:02.550699 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-64192229-1d91-45a6-b179-89bdefb70fca tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] [instance: 3c7c536b-2058-4226-938c-65ec0ad3dddc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='357a1479-6cbd-4882-8d3f-d945fa40e6df',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118344) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 20:05:02.734532 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-91aecac0-eec0-4a27-b26e-19c548f0598d tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Flavor limits 0:0:0 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 20:05:02.735125 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-91aecac0-eec0-4a27-b26e-19c548f0598d tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Image limits 0:0:0 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 20:05:02.735747 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-91aecac0-eec0-4a27-b26e-19c548f0598d tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Flavor pref 0:0:0 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 20:05:02.736543 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-91aecac0-eec0-4a27-b26e-19c548f0598d tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Image pref 0:0:0 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 20:05:02.737105 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-91aecac0-eec0-4a27-b26e-19c548f0598d tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 20:05:02.750921 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-91aecac0-eec0-4a27-b26e-19c548f0598d tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:02.751624 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-91aecac0-eec0-4a27-b26e-19c548f0598d tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:02.753236 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-91aecac0-eec0-4a27-b26e-19c548f0598d tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:02.753236 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-91aecac0-eec0-4a27-b26e-19c548f0598d tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:02.774126 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.quota [None req-91aecac0-eec0-4a27-b26e-19c548f0598d tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Getting quotas for project 6d4acf1287ad4dac9bbf6dc27f427a7c. Resources: {'instances', 'cores', 'ram'} {{(pid=118345) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 20:05:02.787888 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.quota [None req-91aecac0-eec0-4a27-b26e-19c548f0598d tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Getting quotas for user df9139f72d004b2fac1cba17647c129d and project 6d4acf1287ad4dac9bbf6dc27f427a7c. Resources: {'instances', 'cores', 'ram'} {{(pid=118345) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 20:05:02.800873 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-91aecac0-eec0-4a27-b26e-19c548f0598d tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Going to run 1 instances... {{(pid=118345) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 20:05:02.803324 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-91aecac0-eec0-4a27-b26e-19c548f0598d tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 514a7771-fbf2-46db-9e3d-905a6a3e703d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='357a1479-6cbd-4882-8d3f-d945fa40e6df',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118345) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 20:05:02.844778 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-64192229-1d91-45a6-b179-89bdefb70fca tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.525977 Jul 21 20:05:02.851602 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 16/29] 10.222.0.58 () {60 vars in 1146 bytes} [Thu Jul 21 20:04:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 3534 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 21 20:05:02.871852 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-5cf001e4-140b-4b31-9a0f-7e96c4158319 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-663692644", "imageRef": "357a1479-6cbd-4882-8d3f-d945fa40e6df", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8c189c91-a136-44cc-8a4c-a42d0a4465fc"}], "security_groups": [{"name": "tempest-securitygroup--310921038"}], "key_name": "tempest-keypair-2054628863", "user_data": "}} {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:05:02.964656 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-91aecac0-eec0-4a27-b26e-19c548f0598d tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.733348 Jul 21 20:05:02.983147 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 14/30] 10.222.0.58 () {60 vars in 1146 bytes} [Thu Jul 21 20:05:01 2022] POST /compute/v2.1/servers => generated 383 bytes in 1749 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 20:05:02.994734 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-28ecc023-e639-479a-8107-4f847c730043 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:02.995543 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-28ecc023-e639-479a-8107-4f847c730043 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] [instance: 3c7c536b-2058-4226-938c-65ec0ad3dddc] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:03.079879 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-28ecc023-e639-479a-8107-4f847c730043 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0100323b16c045b98dec585b9e59f077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc40ec656240410e862fde9531e0fc55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:03.107684 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-28ecc023-e639-479a-8107-4f847c730043 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] 10.222.0.58 "GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc" status: 200 len: 1214 microversion: 2.1 time: 0.126583 Jul 21 20:05:03.110381 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 15/31] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:02 2022] GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc => generated 1214 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:03.125562 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-f259b6f1-37d0-403b-8499-6390af010e85 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:03.133002 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-f259b6f1-37d0-403b-8499-6390af010e85 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 514a7771-fbf2-46db-9e3d-905a6a3e703d] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:03.379292 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-f259b6f1-37d0-403b-8499-6390af010e85 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:03.403336 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-f259b6f1-37d0-403b-8499-6390af010e85 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d" status: 200 len: 1221 microversion: 2.1 time: 0.287255 Jul 21 20:05:03.419899 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 16/32] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:03 2022] GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d => generated 1221 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:03.433420 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.network.neutron [None req-5cf001e4-140b-4b31-9a0f-7e96c4158319 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] validate_networks() for [('8c189c91-a136-44cc-8a4c-a42d0a4465fc', None, None, None, None, None)] {{(pid=118344) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 20:05:04.129477 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-f4b5416c-a956-4656-a0ac-e1774a7c2c6d tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:04.130100 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-f4b5416c-a956-4656-a0ac-e1774a7c2c6d tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] [instance: 3c7c536b-2058-4226-938c-65ec0ad3dddc] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:04.410056 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-f4b5416c-a956-4656-a0ac-e1774a7c2c6d tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0100323b16c045b98dec585b9e59f077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc40ec656240410e862fde9531e0fc55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:04.422747 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-f4b5416c-a956-4656-a0ac-e1774a7c2c6d tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] 10.222.0.58 "GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc" status: 200 len: 1214 microversion: 2.1 time: 0.299094 Jul 21 20:05:04.429840 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 17/33] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:04 2022] GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc => generated 1214 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:05:04.440938 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-ef35da95-6c6e-4e8b-bc24-fc4ea67bc590 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:04.441570 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-ef35da95-6c6e-4e8b-bc24-fc4ea67bc590 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 514a7771-fbf2-46db-9e3d-905a6a3e703d] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:04.541917 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-ef35da95-6c6e-4e8b-bc24-fc4ea67bc590 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:04.552150 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-ef35da95-6c6e-4e8b-bc24-fc4ea67bc590 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d" status: 200 len: 1221 microversion: 2.1 time: 0.120521 Jul 21 20:05:04.554586 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 18/34] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:04 2022] GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d => generated 1221 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:05.446363 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-ff12f35f-e1ce-4266-8a95-c1b41238440f tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:05.456003 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-ff12f35f-e1ce-4266-8a95-c1b41238440f tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] [instance: 3c7c536b-2058-4226-938c-65ec0ad3dddc] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:05.624878 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-ff12f35f-e1ce-4266-8a95-c1b41238440f tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0100323b16c045b98dec585b9e59f077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc40ec656240410e862fde9531e0fc55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:05.637229 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-ff12f35f-e1ce-4266-8a95-c1b41238440f tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] 10.222.0.58 "GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc" status: 200 len: 1214 microversion: 2.1 time: 0.195214 Jul 21 20:05:05.644192 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 19/35] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:05 2022] GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc => generated 1214 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:05.672416 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-62abf800-6705-42fc-97f4-8f8017d7d4eb tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:05.677235 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-62abf800-6705-42fc-97f4-8f8017d7d4eb tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 514a7771-fbf2-46db-9e3d-905a6a3e703d] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:05.709516 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-62abf800-6705-42fc-97f4-8f8017d7d4eb tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:05.709995 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-62abf800-6705-42fc-97f4-8f8017d7d4eb tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:05.710794 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-62abf800-6705-42fc-97f4-8f8017d7d4eb tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:05.711268 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-62abf800-6705-42fc-97f4-8f8017d7d4eb tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:06.259170 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-62abf800-6705-42fc-97f4-8f8017d7d4eb tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:06.301850 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-62abf800-6705-42fc-97f4-8f8017d7d4eb tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d" status: 200 len: 1217 microversion: 2.1 time: 0.646942 Jul 21 20:05:06.302460 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 20/36] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:05 2022] GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d => generated 1217 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:06.320748 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-cf14cd28-1fe7-4652-9227-896340f15158 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-884155943", "imageRef": "357a1479-6cbd-4882-8d3f-d945fa40e6df", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ff765712-4fe3-49eb-a488-ee6e245cfbb3"}], "security_groups": [{"name": "tempest-securitygroup--1418178720"}], "key_name": "tempest-keypair-610516389", "user_data": "}} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:05:06.363587 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.virt.hardware [None req-5cf001e4-140b-4b31-9a0f-7e96c4158319 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Flavor limits 0:0:0 {{(pid=118344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 20:05:06.364694 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.virt.hardware [None req-5cf001e4-140b-4b31-9a0f-7e96c4158319 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Image limits 0:0:0 {{(pid=118344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 20:05:06.365198 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.virt.hardware [None req-5cf001e4-140b-4b31-9a0f-7e96c4158319 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Flavor pref 0:0:0 {{(pid=118344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 20:05:06.365507 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.virt.hardware [None req-5cf001e4-140b-4b31-9a0f-7e96c4158319 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Image pref 0:0:0 {{(pid=118344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 20:05:06.366105 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.virt.hardware [None req-5cf001e4-140b-4b31-9a0f-7e96c4158319 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 20:05:06.392172 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-5cf001e4-140b-4b31-9a0f-7e96c4158319 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:06.392172 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-5cf001e4-140b-4b31-9a0f-7e96c4158319 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:06.410960 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-5cf001e4-140b-4b31-9a0f-7e96c4158319 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:06.411557 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-5cf001e4-140b-4b31-9a0f-7e96c4158319 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:06.462835 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.quota [None req-5cf001e4-140b-4b31-9a0f-7e96c4158319 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Getting quotas for project e0075f5ba84547c782504d23f6029fd2. Resources: {'instances', 'cores', 'ram'} {{(pid=118344) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 20:05:06.474404 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.quota [None req-5cf001e4-140b-4b31-9a0f-7e96c4158319 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Getting quotas for user d04a0e68aea7424181f6c2728cbf7e3f and project e0075f5ba84547c782504d23f6029fd2. Resources: {'instances', 'cores', 'ram'} {{(pid=118344) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 20:05:06.501017 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-5cf001e4-140b-4b31-9a0f-7e96c4158319 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Going to run 1 instances... {{(pid=118344) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 20:05:06.503222 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-5cf001e4-140b-4b31-9a0f-7e96c4158319 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 8f00566b-862b-4171-9259-b12aaa7ea030] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='357a1479-6cbd-4882-8d3f-d945fa40e6df',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118344) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 20:05:06.672123 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.network.neutron [None req-cf14cd28-1fe7-4652-9227-896340f15158 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] validate_networks() for [('ff765712-4fe3-49eb-a488-ee6e245cfbb3', None, None, None, None, None)] {{(pid=118345) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 20:05:06.740272 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-5cf001e4-140b-4b31-9a0f-7e96c4158319 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.887207 Jul 21 20:05:06.744110 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 17/37] 10.222.0.58 () {60 vars in 1146 bytes} [Thu Jul 21 20:05:02 2022] POST /compute/v2.1/servers => generated 401 bytes in 3892 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 20:05:06.762092 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-f2c22f73-353b-4090-9a15-a181e0dd7e8a tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1992482850", "imageRef": "357a1479-6cbd-4882-8d3f-d945fa40e6df", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cd4c759b-bfd8-477c-ab70-2c24a78186e7"}], "security_groups": [{"name": "tempest-securitygroup--753804697"}], "key_name": "tempest-keypair-653216594", "user_data": "}} {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:05:07.005615 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.network.neutron [None req-f2c22f73-353b-4090-9a15-a181e0dd7e8a tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] validate_networks() for [('cd4c759b-bfd8-477c-ab70-2c24a78186e7', None, None, None, None, None)] {{(pid=118344) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 20:05:07.735782 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-cf14cd28-1fe7-4652-9227-896340f15158 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Flavor limits 0:0:0 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 20:05:07.736289 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-cf14cd28-1fe7-4652-9227-896340f15158 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Image limits 0:0:0 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 20:05:07.736670 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-cf14cd28-1fe7-4652-9227-896340f15158 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Flavor pref 0:0:0 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 20:05:07.737279 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-cf14cd28-1fe7-4652-9227-896340f15158 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Image pref 0:0:0 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 20:05:07.737846 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-cf14cd28-1fe7-4652-9227-896340f15158 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 20:05:07.755915 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-cf14cd28-1fe7-4652-9227-896340f15158 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:07.756398 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-cf14cd28-1fe7-4652-9227-896340f15158 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:07.757215 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-cf14cd28-1fe7-4652-9227-896340f15158 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:07.757662 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-cf14cd28-1fe7-4652-9227-896340f15158 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:07.790341 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.quota [None req-cf14cd28-1fe7-4652-9227-896340f15158 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Getting quotas for project f8ece8b465c04d33998002f8d880d556. Resources: {'instances', 'cores', 'ram'} {{(pid=118345) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 20:05:07.799037 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.quota [None req-cf14cd28-1fe7-4652-9227-896340f15158 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Getting quotas for user 02a93000972547d08f11f7ed23264d31 and project f8ece8b465c04d33998002f8d880d556. Resources: {'instances', 'cores', 'ram'} {{(pid=118345) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 20:05:07.837508 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-cf14cd28-1fe7-4652-9227-896340f15158 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Going to run 1 instances... {{(pid=118345) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 20:05:07.845628 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-cf14cd28-1fe7-4652-9227-896340f15158 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='357a1479-6cbd-4882-8d3f-d945fa40e6df',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118345) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 20:05:08.116232 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-cf14cd28-1fe7-4652-9227-896340f15158 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.812462 Jul 21 20:05:08.118350 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 21/38] 10.222.0.58 () {62 vars in 1187 bytes} [Thu Jul 21 20:05:06 2022] POST /compute/v2.1/servers => generated 402 bytes in 1815 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 21 20:05:08.126362 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-79c0b0cc-8e7e-4d61-9602-b8eac518f61c tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:08.127361 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-79c0b0cc-8e7e-4d61-9602-b8eac518f61c tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] [instance: 3c7c536b-2058-4226-938c-65ec0ad3dddc] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:08.138138 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-79c0b0cc-8e7e-4d61-9602-b8eac518f61c tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:08.139008 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-79c0b0cc-8e7e-4d61-9602-b8eac518f61c tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:08.140225 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-79c0b0cc-8e7e-4d61-9602-b8eac518f61c tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:08.140892 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-79c0b0cc-8e7e-4d61-9602-b8eac518f61c tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:08.390868 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-79c0b0cc-8e7e-4d61-9602-b8eac518f61c tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0100323b16c045b98dec585b9e59f077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc40ec656240410e862fde9531e0fc55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:08.399659 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-79c0b0cc-8e7e-4d61-9602-b8eac518f61c tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] 10.222.0.58 "GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc" status: 200 len: 1266 microversion: 2.1 time: 0.279288 Jul 21 20:05:08.416565 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 22/39] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:08 2022] GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc => generated 1266 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:08.421274 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-1b869563-f07e-4356-8d99-f57daf542848 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:08.431349 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-1b869563-f07e-4356-8d99-f57daf542848 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 8f00566b-862b-4171-9259-b12aaa7ea030] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:08.633070 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-1b869563-f07e-4356-8d99-f57daf542848 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:08.650328 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-1b869563-f07e-4356-8d99-f57daf542848 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030" status: 200 len: 1241 microversion: 2.1 time: 0.232980 Jul 21 20:05:08.654710 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 23/40] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:08 2022] GET /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030 => generated 1241 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:08.673045 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-422ef70d-f4c5-4a29-aa51-5a67e5cb8250 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:08.673045 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-422ef70d-f4c5-4a29-aa51-5a67e5cb8250 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 514a7771-fbf2-46db-9e3d-905a6a3e703d] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:08.677308 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-422ef70d-f4c5-4a29-aa51-5a67e5cb8250 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:08.681241 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-422ef70d-f4c5-4a29-aa51-5a67e5cb8250 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:08.682262 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-422ef70d-f4c5-4a29-aa51-5a67e5cb8250 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:08.682846 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-422ef70d-f4c5-4a29-aa51-5a67e5cb8250 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:09.101237 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-422ef70d-f4c5-4a29-aa51-5a67e5cb8250 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:09.112625 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-422ef70d-f4c5-4a29-aa51-5a67e5cb8250 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d" status: 200 len: 1279 microversion: 2.1 time: 0.456233 Jul 21 20:05:09.113231 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 24/41] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:08 2022] GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d => generated 1279 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:09.131119 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-23d3b84e-2744-49dc-992a-1ad3f8dd8f0b tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:09.133248 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-23d3b84e-2744-49dc-992a-1ad3f8dd8f0b tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:09.172686 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:05:09.254578 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-23d3b84e-2744-49dc-992a-1ad3f8dd8f0b tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:09.264236 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-23d3b84e-2744-49dc-992a-1ad3f8dd8f0b tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:09.275091 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-23d3b84e-2744-49dc-992a-1ad3f8dd8f0b tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:09.275091 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-23d3b84e-2744-49dc-992a-1ad3f8dd8f0b tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1280 microversion: 2.20 time: 0.149279 Jul 21 20:05:09.275091 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 25/42] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:05:09 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1280 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:05:09.421514 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-f688efd2-05a7-4373-a33a-629f2570d85f tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:09.426980 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-f688efd2-05a7-4373-a33a-629f2570d85f tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] [instance: 3c7c536b-2058-4226-938c-65ec0ad3dddc] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:09.439197 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f688efd2-05a7-4373-a33a-629f2570d85f tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:09.439789 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f688efd2-05a7-4373-a33a-629f2570d85f tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:09.440751 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f688efd2-05a7-4373-a33a-629f2570d85f tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:09.441140 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f688efd2-05a7-4373-a33a-629f2570d85f tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:09.662776 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-f688efd2-05a7-4373-a33a-629f2570d85f tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0100323b16c045b98dec585b9e59f077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc40ec656240410e862fde9531e0fc55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:09.672401 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-f688efd2-05a7-4373-a33a-629f2570d85f tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] 10.222.0.58 "GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc" status: 200 len: 1272 microversion: 2.1 time: 0.255539 Jul 21 20:05:09.672986 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 26/43] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:09 2022] GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc => generated 1272 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:09.700476 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-dde5e570-0a7f-41ba-a6ba-df3d9b15a35e tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:09.702650 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-dde5e570-0a7f-41ba-a6ba-df3d9b15a35e tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 8f00566b-862b-4171-9259-b12aaa7ea030] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:09.728184 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-dde5e570-0a7f-41ba-a6ba-df3d9b15a35e tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:09.729992 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-dde5e570-0a7f-41ba-a6ba-df3d9b15a35e tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:09.729992 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-dde5e570-0a7f-41ba-a6ba-df3d9b15a35e tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:09.733367 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-dde5e570-0a7f-41ba-a6ba-df3d9b15a35e tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:09.739943 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.virt.hardware [None req-f2c22f73-353b-4090-9a15-a181e0dd7e8a tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Flavor limits 0:0:0 {{(pid=118344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 20:05:09.740416 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.virt.hardware [None req-f2c22f73-353b-4090-9a15-a181e0dd7e8a tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Image limits 0:0:0 {{(pid=118344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 20:05:09.740842 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.virt.hardware [None req-f2c22f73-353b-4090-9a15-a181e0dd7e8a tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Flavor pref 0:0:0 {{(pid=118344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 20:05:09.741347 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.virt.hardware [None req-f2c22f73-353b-4090-9a15-a181e0dd7e8a tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Image pref 0:0:0 {{(pid=118344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 20:05:09.741762 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.virt.hardware [None req-f2c22f73-353b-4090-9a15-a181e0dd7e8a tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 20:05:09.773320 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f2c22f73-353b-4090-9a15-a181e0dd7e8a tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:09.773917 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f2c22f73-353b-4090-9a15-a181e0dd7e8a tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:09.774931 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f2c22f73-353b-4090-9a15-a181e0dd7e8a tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:09.775640 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f2c22f73-353b-4090-9a15-a181e0dd7e8a tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:09.830504 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.quota [None req-f2c22f73-353b-4090-9a15-a181e0dd7e8a tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Getting quotas for project f5e462e9247c4feab7e498186a547728. Resources: {'instances', 'cores', 'ram'} {{(pid=118344) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 20:05:09.843407 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.quota [None req-f2c22f73-353b-4090-9a15-a181e0dd7e8a tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Getting quotas for user 44f668466fa542039e88b4fc7714de81 and project f5e462e9247c4feab7e498186a547728. Resources: {'instances', 'cores', 'ram'} {{(pid=118344) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 20:05:09.876339 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-f2c22f73-353b-4090-9a15-a181e0dd7e8a tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Going to run 1 instances... {{(pid=118344) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 20:05:09.883333 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-f2c22f73-353b-4090-9a15-a181e0dd7e8a tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='357a1479-6cbd-4882-8d3f-d945fa40e6df',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118344) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 20:05:09.951364 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-dde5e570-0a7f-41ba-a6ba-df3d9b15a35e tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:09.961632 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-dde5e570-0a7f-41ba-a6ba-df3d9b15a35e tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030" status: 200 len: 1237 microversion: 2.1 time: 0.286432 Jul 21 20:05:09.979124 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 27/44] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:09 2022] GET /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030 => generated 1237 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:10.131886 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-24dac544-54e9-4e45-ad9c-dccfe671fb9c tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:10.132503 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-24dac544-54e9-4e45-ad9c-dccfe671fb9c tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 514a7771-fbf2-46db-9e3d-905a6a3e703d] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:10.166624 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-24dac544-54e9-4e45-ad9c-dccfe671fb9c tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:10.168283 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-24dac544-54e9-4e45-ad9c-dccfe671fb9c tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:10.168627 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-f2c22f73-353b-4090-9a15-a181e0dd7e8a tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.416153 Jul 21 20:05:10.169448 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 18/45] 10.222.0.58 () {60 vars in 1146 bytes} [Thu Jul 21 20:05:06 2022] POST /compute/v2.1/servers => generated 401 bytes in 3423 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 20:05:10.178910 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-24dac544-54e9-4e45-ad9c-dccfe671fb9c tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:10.179860 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-24dac544-54e9-4e45-ad9c-dccfe671fb9c tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:10.195222 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-3129252b-625b-4517-9487-eb9e3ba6fbe0 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:10.195222 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-3129252b-625b-4517-9487-eb9e3ba6fbe0 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:10.428432 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-24dac544-54e9-4e45-ad9c-dccfe671fb9c tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:10.447225 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-24dac544-54e9-4e45-ad9c-dccfe671fb9c tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d" status: 200 len: 1279 microversion: 2.1 time: 0.318732 Jul 21 20:05:10.459285 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 28/46] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:10 2022] GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d => generated 1279 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:10.475392 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-567ed3b3-b64d-423b-9373-6dd72dbccff9 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:10.476215 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-567ed3b3-b64d-423b-9373-6dd72dbccff9 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:10.489496 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-567ed3b3-b64d-423b-9373-6dd72dbccff9 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:10.490190 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-567ed3b3-b64d-423b-9373-6dd72dbccff9 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:10.494851 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-567ed3b3-b64d-423b-9373-6dd72dbccff9 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:10.495612 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-567ed3b3-b64d-423b-9373-6dd72dbccff9 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:11.016879 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-3129252b-625b-4517-9487-eb9e3ba6fbe0 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:11.066509 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-567ed3b3-b64d-423b-9373-6dd72dbccff9 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:11.076357 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-3129252b-625b-4517-9487-eb9e3ba6fbe0 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a" status: 200 len: 1237 microversion: 2.1 time: 0.895998 Jul 21 20:05:11.076953 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 19/47] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:10 2022] GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a => generated 1237 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:11.077721 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-567ed3b3-b64d-423b-9373-6dd72dbccff9 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:11.089044 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-567ed3b3-b64d-423b-9373-6dd72dbccff9 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:11.090647 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-567ed3b3-b64d-423b-9373-6dd72dbccff9 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1284 microversion: 2.20 time: 0.628108 Jul 21 20:05:11.095236 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 29/48] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:05:10 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1284 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:05:11.100278 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-fccc0a21-e422-4337-8231-0cdf98fb1453 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:11.100906 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-fccc0a21-e422-4337-8231-0cdf98fb1453 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] [instance: 3c7c536b-2058-4226-938c-65ec0ad3dddc] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:11.109181 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-6dbbaaae-ae67-49e3-9885-0ec32dbfcfd9 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:11.119983 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-6dbbaaae-ae67-49e3-9885-0ec32dbfcfd9 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 8f00566b-862b-4171-9259-b12aaa7ea030] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:11.121790 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-fccc0a21-e422-4337-8231-0cdf98fb1453 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:11.123163 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-fccc0a21-e422-4337-8231-0cdf98fb1453 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:11.135754 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6dbbaaae-ae67-49e3-9885-0ec32dbfcfd9 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:11.136255 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6dbbaaae-ae67-49e3-9885-0ec32dbfcfd9 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:11.136776 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-fccc0a21-e422-4337-8231-0cdf98fb1453 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:11.137529 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-fccc0a21-e422-4337-8231-0cdf98fb1453 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:11.152223 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6dbbaaae-ae67-49e3-9885-0ec32dbfcfd9 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:11.157431 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6dbbaaae-ae67-49e3-9885-0ec32dbfcfd9 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:11.633736 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-6dbbaaae-ae67-49e3-9885-0ec32dbfcfd9 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:11.651770 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-6dbbaaae-ae67-49e3-9885-0ec32dbfcfd9 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030" status: 200 len: 1301 microversion: 2.1 time: 0.555203 Jul 21 20:05:11.697782 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 30/49] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:11 2022] GET /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030 => generated 1301 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:11.699245 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-fccc0a21-e422-4337-8231-0cdf98fb1453 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0100323b16c045b98dec585b9e59f077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc40ec656240410e862fde9531e0fc55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:11.702821 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-d678b6d3-845b-4f24-a76e-9b6a116d04c3 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:11.703494 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-d678b6d3-845b-4f24-a76e-9b6a116d04c3 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 514a7771-fbf2-46db-9e3d-905a6a3e703d] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:11.716541 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-fccc0a21-e422-4337-8231-0cdf98fb1453 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] 10.222.0.58 "GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc" status: 200 len: 1272 microversion: 2.1 time: 0.625336 Jul 21 20:05:11.719950 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 20/50] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:11 2022] GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc => generated 1272 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:11.737489 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d678b6d3-845b-4f24-a76e-9b6a116d04c3 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:11.737890 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d678b6d3-845b-4f24-a76e-9b6a116d04c3 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:11.738715 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d678b6d3-845b-4f24-a76e-9b6a116d04c3 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:11.739179 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d678b6d3-845b-4f24-a76e-9b6a116d04c3 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:12.095169 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-53662587-b6cc-4e78-ab65-c7b13520a07a tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:12.106527 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-53662587-b6cc-4e78-ab65-c7b13520a07a tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:12.305156 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-53662587-b6cc-4e78-ab65-c7b13520a07a tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:12.325904 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-53662587-b6cc-4e78-ab65-c7b13520a07a tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a" status: 200 len: 1237 microversion: 2.1 time: 0.230090 Jul 21 20:05:12.325904 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 21/51] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:12 2022] GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a => generated 1237 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:05:12.364246 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-9ce97343-fca0-4bb8-be31-c6b2f31a111a tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:12.364246 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-9ce97343-fca0-4bb8-be31-c6b2f31a111a tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:12.379245 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-9ce97343-fca0-4bb8-be31-c6b2f31a111a tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:12.381987 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-9ce97343-fca0-4bb8-be31-c6b2f31a111a tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:12.383309 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-9ce97343-fca0-4bb8-be31-c6b2f31a111a tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:12.383995 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-9ce97343-fca0-4bb8-be31-c6b2f31a111a tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:12.808823 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-d678b6d3-845b-4f24-a76e-9b6a116d04c3 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:12.824846 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-d678b6d3-845b-4f24-a76e-9b6a116d04c3 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d" status: 200 len: 1321 microversion: 2.1 time: 1.149028 Jul 21 20:05:12.842244 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 31/52] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:11 2022] GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d => generated 1321 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:12.863826 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-4331010f-81ef-4136-bb6e-5fdf202ca1fd tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:12.864587 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-4331010f-81ef-4136-bb6e-5fdf202ca1fd tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 8f00566b-862b-4171-9259-b12aaa7ea030] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:12.872648 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-9ce97343-fca0-4bb8-be31-c6b2f31a111a tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:12.881877 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4331010f-81ef-4136-bb6e-5fdf202ca1fd tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:12.889434 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4331010f-81ef-4136-bb6e-5fdf202ca1fd tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:12.889563 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-9ce97343-fca0-4bb8-be31-c6b2f31a111a tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:12.889691 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4331010f-81ef-4136-bb6e-5fdf202ca1fd tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:12.889691 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4331010f-81ef-4136-bb6e-5fdf202ca1fd tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:12.903962 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-9ce97343-fca0-4bb8-be31-c6b2f31a111a tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:12.905766 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-9ce97343-fca0-4bb8-be31-c6b2f31a111a tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1332 microversion: 2.20 time: 0.583212 Jul 21 20:05:12.915935 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 22/53] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:05:12 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1332 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:05:12.963293 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-fa343c46-13c0-42ed-85c3-ebb5fb78e749 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:12.963924 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-fa343c46-13c0-42ed-85c3-ebb5fb78e749 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] [instance: 3c7c536b-2058-4226-938c-65ec0ad3dddc] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:12.989907 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-fa343c46-13c0-42ed-85c3-ebb5fb78e749 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:12.989907 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-fa343c46-13c0-42ed-85c3-ebb5fb78e749 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:12.989907 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-fa343c46-13c0-42ed-85c3-ebb5fb78e749 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:12.990620 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-fa343c46-13c0-42ed-85c3-ebb5fb78e749 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:13.093670 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-4331010f-81ef-4136-bb6e-5fdf202ca1fd tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:13.109031 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-4331010f-81ef-4136-bb6e-5fdf202ca1fd tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030" status: 200 len: 1299 microversion: 2.1 time: 0.265264 Jul 21 20:05:13.117900 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 32/54] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:12 2022] GET /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030 => generated 1299 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:13.339782 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-af11ae99-0d88-4de4-a056-04ee5cc10495 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:13.341097 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-af11ae99-0d88-4de4-a056-04ee5cc10495 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:13.353089 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-af11ae99-0d88-4de4-a056-04ee5cc10495 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:13.359365 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-af11ae99-0d88-4de4-a056-04ee5cc10495 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:13.363964 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-af11ae99-0d88-4de4-a056-04ee5cc10495 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:13.364606 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-af11ae99-0d88-4de4-a056-04ee5cc10495 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:13.686347 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-af11ae99-0d88-4de4-a056-04ee5cc10495 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:13.698540 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-af11ae99-0d88-4de4-a056-04ee5cc10495 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a" status: 200 len: 1233 microversion: 2.1 time: 0.361414 Jul 21 20:05:13.699184 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 33/55] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:13 2022] GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a => generated 1233 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:13.852321 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-d8c409e9-84f7-4fee-a633-eb5bfb9596a9 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:13.854030 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-d8c409e9-84f7-4fee-a633-eb5bfb9596a9 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 514a7771-fbf2-46db-9e3d-905a6a3e703d] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:13.873025 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d8c409e9-84f7-4fee-a633-eb5bfb9596a9 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:13.874701 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d8c409e9-84f7-4fee-a633-eb5bfb9596a9 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:13.876462 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d8c409e9-84f7-4fee-a633-eb5bfb9596a9 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:13.877087 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d8c409e9-84f7-4fee-a633-eb5bfb9596a9 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:14.148790 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-fa343c46-13c0-42ed-85c3-ebb5fb78e749 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0100323b16c045b98dec585b9e59f077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc40ec656240410e862fde9531e0fc55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:14.163720 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-fa343c46-13c0-42ed-85c3-ebb5fb78e749 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] 10.222.0.58 "GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc" status: 200 len: 1314 microversion: 2.1 time: 1.228275 Jul 21 20:05:14.164556 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 23/56] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:12 2022] GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc => generated 1314 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:14.186462 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-8252c331-bd99-4edb-8fd1-c8723c76d1fa tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:14.187104 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-8252c331-bd99-4edb-8fd1-c8723c76d1fa tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:14.211408 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-8252c331-bd99-4edb-8fd1-c8723c76d1fa tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:14.211860 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-8252c331-bd99-4edb-8fd1-c8723c76d1fa tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:14.212661 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-8252c331-bd99-4edb-8fd1-c8723c76d1fa tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:14.213120 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-8252c331-bd99-4edb-8fd1-c8723c76d1fa tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:14.443835 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-d8c409e9-84f7-4fee-a633-eb5bfb9596a9 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:14.453948 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-d8c409e9-84f7-4fee-a633-eb5bfb9596a9 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d" status: 200 len: 1321 microversion: 2.1 time: 0.610453 Jul 21 20:05:14.461030 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 34/57] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:13 2022] GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d => generated 1321 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:05:14.470134 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-bd98a323-ddeb-4865-a443-3af88d3fa772 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:14.477397 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-bd98a323-ddeb-4865-a443-3af88d3fa772 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 8f00566b-862b-4171-9259-b12aaa7ea030] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:14.493140 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-bd98a323-ddeb-4865-a443-3af88d3fa772 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:14.495206 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-bd98a323-ddeb-4865-a443-3af88d3fa772 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:14.495206 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-bd98a323-ddeb-4865-a443-3af88d3fa772 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:14.496150 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-bd98a323-ddeb-4865-a443-3af88d3fa772 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:14.693606 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-bd98a323-ddeb-4865-a443-3af88d3fa772 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:14.714412 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-bd98a323-ddeb-4865-a443-3af88d3fa772 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030" status: 200 len: 1299 microversion: 2.1 time: 0.250730 Jul 21 20:05:14.716467 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 35/58] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:14 2022] GET /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030 => generated 1299 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:14.743117 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-3322e231-d83d-428d-886d-72430dd78e00 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:14.744800 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-3322e231-d83d-428d-886d-72430dd78e00 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:14.771270 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3322e231-d83d-428d-886d-72430dd78e00 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:14.772465 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3322e231-d83d-428d-886d-72430dd78e00 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:14.775971 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3322e231-d83d-428d-886d-72430dd78e00 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:14.777860 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3322e231-d83d-428d-886d-72430dd78e00 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:14.854720 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-8252c331-bd99-4edb-8fd1-c8723c76d1fa tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:14.873679 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-8252c331-bd99-4edb-8fd1-c8723c76d1fa tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:14.888286 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-8252c331-bd99-4edb-8fd1-c8723c76d1fa tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:14.891185 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-8252c331-bd99-4edb-8fd1-c8723c76d1fa tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1338 microversion: 2.20 time: 0.712911 Jul 21 20:05:14.892714 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 24/59] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:05:14 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1338 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:05:15.084876 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-3322e231-d83d-428d-886d-72430dd78e00 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:15.096347 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-3322e231-d83d-428d-886d-72430dd78e00 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a" status: 200 len: 1297 microversion: 2.1 time: 0.377755 Jul 21 20:05:15.125561 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 36/60] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:14 2022] GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a => generated 1297 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:15.182942 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-10a3dc5a-b3e4-414d-a147-9faebc3f35e7 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:15.183566 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-10a3dc5a-b3e4-414d-a147-9faebc3f35e7 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] [instance: 3c7c536b-2058-4226-938c-65ec0ad3dddc] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:15.195350 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-10a3dc5a-b3e4-414d-a147-9faebc3f35e7 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:15.196006 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-10a3dc5a-b3e4-414d-a147-9faebc3f35e7 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:15.198057 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-10a3dc5a-b3e4-414d-a147-9faebc3f35e7 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:15.200489 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-10a3dc5a-b3e4-414d-a147-9faebc3f35e7 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:15.474990 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-92be2fca-8c90-42d5-9b36-61168a97201e tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:15.475634 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-92be2fca-8c90-42d5-9b36-61168a97201e tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 514a7771-fbf2-46db-9e3d-905a6a3e703d] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:15.489131 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-92be2fca-8c90-42d5-9b36-61168a97201e tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:15.489591 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-92be2fca-8c90-42d5-9b36-61168a97201e tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:15.491667 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-92be2fca-8c90-42d5-9b36-61168a97201e tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:15.492365 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-92be2fca-8c90-42d5-9b36-61168a97201e tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:16.287182 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-10a3dc5a-b3e4-414d-a147-9faebc3f35e7 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0100323b16c045b98dec585b9e59f077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc40ec656240410e862fde9531e0fc55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:16.305033 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-10a3dc5a-b3e4-414d-a147-9faebc3f35e7 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] 10.222.0.58 "GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc" status: 200 len: 1314 microversion: 2.1 time: 1.123621 Jul 21 20:05:16.310600 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 25/61] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:15 2022] GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc => generated 1314 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:16.332715 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-75ca969f-7c7d-46e7-a461-80727834f4e4 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:16.333501 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-75ca969f-7c7d-46e7-a461-80727834f4e4 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 8f00566b-862b-4171-9259-b12aaa7ea030] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:16.364407 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-75ca969f-7c7d-46e7-a461-80727834f4e4 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:16.371089 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-75ca969f-7c7d-46e7-a461-80727834f4e4 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:16.373297 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-75ca969f-7c7d-46e7-a461-80727834f4e4 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:16.373755 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-75ca969f-7c7d-46e7-a461-80727834f4e4 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:17.201843 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-92be2fca-8c90-42d5-9b36-61168a97201e tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:17.238337 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-92be2fca-8c90-42d5-9b36-61168a97201e tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d" status: 200 len: 1321 microversion: 2.1 time: 1.768451 Jul 21 20:05:17.245806 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 37/62] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:15 2022] GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d => generated 1321 bytes in 1777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:17.268421 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-4646b7a1-79fb-43f0-8807-fa4396738ab9 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:17.272887 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-4646b7a1-79fb-43f0-8807-fa4396738ab9 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:17.299047 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4646b7a1-79fb-43f0-8807-fa4396738ab9 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:17.300360 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4646b7a1-79fb-43f0-8807-fa4396738ab9 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:17.308886 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4646b7a1-79fb-43f0-8807-fa4396738ab9 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:17.309895 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4646b7a1-79fb-43f0-8807-fa4396738ab9 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:17.366161 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell1:SELECT=100 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:05:17.485696 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-4646b7a1-79fb-43f0-8807-fa4396738ab9 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:17.535209 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-4646b7a1-79fb-43f0-8807-fa4396738ab9 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:17.539824 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-4646b7a1-79fb-43f0-8807-fa4396738ab9 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:17.541449 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-4646b7a1-79fb-43f0-8807-fa4396738ab9 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1338 microversion: 2.20 time: 0.294290 Jul 21 20:05:17.544017 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 38/63] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:05:17 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1338 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:05:17.557408 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-f2dcf7fe-697d-400f-8f3e-bbb1475450d3 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:17.558483 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-f2dcf7fe-697d-400f-8f3e-bbb1475450d3 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:17.577792 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f2dcf7fe-697d-400f-8f3e-bbb1475450d3 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:17.581116 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f2dcf7fe-697d-400f-8f3e-bbb1475450d3 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:17.584238 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f2dcf7fe-697d-400f-8f3e-bbb1475450d3 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:17.585241 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f2dcf7fe-697d-400f-8f3e-bbb1475450d3 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:17.777304 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell0:SELECT=6 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:05:17.931609 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-75ca969f-7c7d-46e7-a461-80727834f4e4 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:17.940586 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-75ca969f-7c7d-46e7-a461-80727834f4e4 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030" status: 200 len: 1366 microversion: 2.1 time: 1.628349 Jul 21 20:05:17.947807 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 26/64] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:16 2022] GET /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030 => generated 1366 bytes in 1636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:17.984638 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-f2dcf7fe-697d-400f-8f3e-bbb1475450d3 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:17.997793 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-f2dcf7fe-697d-400f-8f3e-bbb1475450d3 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a" status: 200 len: 1295 microversion: 2.1 time: 0.448200 Jul 21 20:05:17.998953 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 39/65] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:17 2022] GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a => generated 1295 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:18.014090 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-c1756fd7-37c0-4ddf-8242-7f69c3fe2753 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:18.017728 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-c1756fd7-37c0-4ddf-8242-7f69c3fe2753 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] [instance: 3c7c536b-2058-4226-938c-65ec0ad3dddc] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:18.032280 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c1756fd7-37c0-4ddf-8242-7f69c3fe2753 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:18.034581 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c1756fd7-37c0-4ddf-8242-7f69c3fe2753 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:18.038044 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c1756fd7-37c0-4ddf-8242-7f69c3fe2753 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:18.040675 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c1756fd7-37c0-4ddf-8242-7f69c3fe2753 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:18.415373 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-c1756fd7-37c0-4ddf-8242-7f69c3fe2753 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0100323b16c045b98dec585b9e59f077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc40ec656240410e862fde9531e0fc55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:18.435448 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-c1756fd7-37c0-4ddf-8242-7f69c3fe2753 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] 10.222.0.58 "GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc" status: 200 len: 1314 microversion: 2.1 time: 0.429139 Jul 21 20:05:18.436091 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 40/66] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:18 2022] GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc => generated 1314 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:18.448803 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-5df52583-801c-4aa4-9c24-cbadce6e8d18 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:18.449611 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-5df52583-801c-4aa4-9c24-cbadce6e8d18 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 514a7771-fbf2-46db-9e3d-905a6a3e703d] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:18.461191 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5df52583-801c-4aa4-9c24-cbadce6e8d18 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:18.461829 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5df52583-801c-4aa4-9c24-cbadce6e8d18 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:18.462893 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5df52583-801c-4aa4-9c24-cbadce6e8d18 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:18.464293 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5df52583-801c-4aa4-9c24-cbadce6e8d18 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:18.493327 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [req-fd027b45-e99f-4557-876f-5f744847e27f req-9445c39d-ee8a-4ba2-b98e-e9f4ed02b940 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c7c536b-2058-4226-938c-65ec0ad3dddc", "tag": "d0b6dfdf-6c03-4e2a-a6e3-7065bda3a505"}]} {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:05:18.534180 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [req-fd027b45-e99f-4557-876f-5f744847e27f req-9445c39d-ee8a-4ba2-b98e-e9f4ed02b940 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:18.535145 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [req-fd027b45-e99f-4557-876f-5f744847e27f req-9445c39d-ee8a-4ba2-b98e-e9f4ed02b940 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:18.592319 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.compute.server_external_events [req-fd027b45-e99f-4557-876f-5f744847e27f req-9445c39d-ee8a-4ba2-b98e-e9f4ed02b940 service nova] Creating event network-changed:d0b6dfdf-6c03-4e2a-a6e3-7065bda3a505 for instance 3c7c536b-2058-4226-938c-65ec0ad3dddc on hv-cinder-85054 Jul 21 20:05:18.593129 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [req-fd027b45-e99f-4557-876f-5f744847e27f req-9445c39d-ee8a-4ba2-b98e-e9f4ed02b940 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118344) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 21 20:05:18.594555 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-69dbfa43-8f93-415c-bff1-c801f585796b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:18.595278 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-69dbfa43-8f93-415c-bff1-c801f585796b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:18.596336 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-69dbfa43-8f93-415c-bff1-c801f585796b None None] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:18.596988 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-69dbfa43-8f93-415c-bff1-c801f585796b None None] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:18.612293 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.compute.rpcapi [None req-69dbfa43-8f93-415c-bff1-c801f585796b None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 21 20:05:18.614206 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-69dbfa43-8f93-415c-bff1-c801f585796b None None] Releasing lock "compute-rpcapi-router" {{(pid=118344) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 21 20:05:18.658859 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-69dbfa43-8f93-415c-bff1-c801f585796b None None] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.709544 Jul 21 20:05:18.660801 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 27/67] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 20:05:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:05:18.666908 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-07415a0f-4bef-4e65-b74d-5e30fdd68fd1 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:18.668222 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-07415a0f-4bef-4e65-b74d-5e30fdd68fd1 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:18.672390 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG dbcounter [-] [118344] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=118344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:05:18.677399 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-07415a0f-4bef-4e65-b74d-5e30fdd68fd1 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:18.678139 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-07415a0f-4bef-4e65-b74d-5e30fdd68fd1 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:18.679185 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-07415a0f-4bef-4e65-b74d-5e30fdd68fd1 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:18.679874 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-07415a0f-4bef-4e65-b74d-5e30fdd68fd1 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:18.922540 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-5df52583-801c-4aa4-9c24-cbadce6e8d18 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:18.937075 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-5df52583-801c-4aa4-9c24-cbadce6e8d18 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d" status: 200 len: 1321 microversion: 2.1 time: 0.492943 Jul 21 20:05:18.937870 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 41/68] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:18 2022] GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d => generated 1321 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:18.966083 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-6cd20372-db90-49af-87b6-f14359205834 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:18.966718 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-6cd20372-db90-49af-87b6-f14359205834 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 8f00566b-862b-4171-9259-b12aaa7ea030] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:18.982505 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6cd20372-db90-49af-87b6-f14359205834 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:18.982961 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6cd20372-db90-49af-87b6-f14359205834 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:18.983766 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6cd20372-db90-49af-87b6-f14359205834 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:18.984202 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6cd20372-db90-49af-87b6-f14359205834 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:19.043045 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-07415a0f-4bef-4e65-b74d-5e30fdd68fd1 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:19.071773 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-07415a0f-4bef-4e65-b74d-5e30fdd68fd1 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:19.082378 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-07415a0f-4bef-4e65-b74d-5e30fdd68fd1 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:19.090334 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-07415a0f-4bef-4e65-b74d-5e30fdd68fd1 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1338 microversion: 2.20 time: 0.428101 Jul 21 20:05:19.095264 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 28/69] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:05:18 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1338 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:05:19.111629 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-40af7af2-5917-4ee4-b3e3-b49e6b9c2515 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:19.119109 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-40af7af2-5917-4ee4-b3e3-b49e6b9c2515 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:19.150696 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-40af7af2-5917-4ee4-b3e3-b49e6b9c2515 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:19.151224 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-40af7af2-5917-4ee4-b3e3-b49e6b9c2515 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:19.152055 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-40af7af2-5917-4ee4-b3e3-b49e6b9c2515 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:19.152547 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-40af7af2-5917-4ee4-b3e3-b49e6b9c2515 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:19.250955 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-6cd20372-db90-49af-87b6-f14359205834 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:19.261478 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-6cd20372-db90-49af-87b6-f14359205834 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030" status: 200 len: 1366 microversion: 2.1 time: 0.300685 Jul 21 20:05:19.276372 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 42/70] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:18 2022] GET /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030 => generated 1366 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:19.313693 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell0:SELECT=38 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:05:19.400697 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [req-55d9cf61-e609-4de9-b8e6-84edc1320490 req-4009ed4d-a9fe-45a0-8461-1bce1711eabe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a615f10-936f-48d1-aad9-e414dc31d016", "tag": "a1660b17-172b-4784-a846-78546f7da506"}]} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:05:19.428745 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-55d9cf61-e609-4de9-b8e6-84edc1320490 req-4009ed4d-a9fe-45a0-8461-1bce1711eabe service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:19.430559 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-55d9cf61-e609-4de9-b8e6-84edc1320490 req-4009ed4d-a9fe-45a0-8461-1bce1711eabe service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:19.486673 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.compute.server_external_events [req-55d9cf61-e609-4de9-b8e6-84edc1320490 req-4009ed4d-a9fe-45a0-8461-1bce1711eabe service nova] Creating event network-changed:a1660b17-172b-4784-a846-78546f7da506 for instance 3a615f10-936f-48d1-aad9-e414dc31d016 on hv-cinder-85054 Jul 21 20:05:19.489269 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-55d9cf61-e609-4de9-b8e6-84edc1320490 req-4009ed4d-a9fe-45a0-8461-1bce1711eabe service nova] Acquired lock "compute-rpcapi-router" {{(pid=118345) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 21 20:05:19.491545 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-240228b6-86ca-4e62-8f58-f3f900a746a5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:19.492109 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-240228b6-86ca-4e62-8f58-f3f900a746a5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:19.493026 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-240228b6-86ca-4e62-8f58-f3f900a746a5 None None] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:19.493686 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-240228b6-86ca-4e62-8f58-f3f900a746a5 None None] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:19.514087 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.compute.rpcapi [None req-240228b6-86ca-4e62-8f58-f3f900a746a5 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 21 20:05:19.516849 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-240228b6-86ca-4e62-8f58-f3f900a746a5 None None] Releasing lock "compute-rpcapi-router" {{(pid=118345) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 21 20:05:19.546574 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-240228b6-86ca-4e62-8f58-f3f900a746a5 None None] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.242663 Jul 21 20:05:19.547375 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 43/71] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 20:05:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 20:05:19.552850 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-8f5fb29f-ebb7-445d-a7ce-e8c93ff032ba tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:19.553555 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-8f5fb29f-ebb7-445d-a7ce-e8c93ff032ba tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] [instance: 3c7c536b-2058-4226-938c-65ec0ad3dddc] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:19.560423 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8f5fb29f-ebb7-445d-a7ce-e8c93ff032ba tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:19.560860 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8f5fb29f-ebb7-445d-a7ce-e8c93ff032ba tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:19.561622 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8f5fb29f-ebb7-445d-a7ce-e8c93ff032ba tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:19.562054 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8f5fb29f-ebb7-445d-a7ce-e8c93ff032ba tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:19.825542 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-8f5fb29f-ebb7-445d-a7ce-e8c93ff032ba tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0100323b16c045b98dec585b9e59f077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc40ec656240410e862fde9531e0fc55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:19.836547 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-8f5fb29f-ebb7-445d-a7ce-e8c93ff032ba tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] 10.222.0.58 "GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc" status: 200 len: 1314 microversion: 2.1 time: 0.287668 Jul 21 20:05:19.843437 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 44/72] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:19 2022] GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc => generated 1314 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:19.893023 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-40af7af2-5917-4ee4-b3e3-b49e6b9c2515 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:19.906523 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-40af7af2-5917-4ee4-b3e3-b49e6b9c2515 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a" status: 200 len: 1362 microversion: 2.1 time: 0.806275 Jul 21 20:05:19.907137 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 29/73] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:19 2022] GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a => generated 1362 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:19.955924 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-09b6792c-4311-402d-b2ab-e339c9e642fe tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:19.956554 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-09b6792c-4311-402d-b2ab-e339c9e642fe tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 514a7771-fbf2-46db-9e3d-905a6a3e703d] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:19.964178 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-09b6792c-4311-402d-b2ab-e339c9e642fe tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:19.969217 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-09b6792c-4311-402d-b2ab-e339c9e642fe tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:19.969217 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-09b6792c-4311-402d-b2ab-e339c9e642fe tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:19.969217 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-09b6792c-4311-402d-b2ab-e339c9e642fe tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:20.111002 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-75a76c66-26d4-4423-8435-a8586383bf21 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:20.112510 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-75a76c66-26d4-4423-8435-a8586383bf21 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:20.120057 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-75a76c66-26d4-4423-8435-a8586383bf21 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:20.125782 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-75a76c66-26d4-4423-8435-a8586383bf21 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:20.129755 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-75a76c66-26d4-4423-8435-a8586383bf21 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:20.129755 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-75a76c66-26d4-4423-8435-a8586383bf21 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:20.185159 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-09b6792c-4311-402d-b2ab-e339c9e642fe tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:20.200190 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-09b6792c-4311-402d-b2ab-e339c9e642fe tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d" status: 200 len: 1321 microversion: 2.1 time: 0.248884 Jul 21 20:05:20.214396 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 45/74] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:19 2022] GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d => generated 1321 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:20.286107 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-6be58bcb-de68-4603-9772-79115b644636 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:20.287080 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-6be58bcb-de68-4603-9772-79115b644636 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 8f00566b-862b-4171-9259-b12aaa7ea030] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:20.293542 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6be58bcb-de68-4603-9772-79115b644636 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:20.294126 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6be58bcb-de68-4603-9772-79115b644636 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:20.295214 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6be58bcb-de68-4603-9772-79115b644636 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:20.295855 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6be58bcb-de68-4603-9772-79115b644636 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:20.555238 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-75a76c66-26d4-4423-8435-a8586383bf21 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:20.570625 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-75a76c66-26d4-4423-8435-a8586383bf21 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:20.573952 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-75a76c66-26d4-4423-8435-a8586383bf21 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:20.575561 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-75a76c66-26d4-4423-8435-a8586383bf21 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1406 microversion: 2.20 time: 0.469229 Jul 21 20:05:20.577568 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 30/75] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:05:20 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1406 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:05:20.614026 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-6be58bcb-de68-4603-9772-79115b644636 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:20.623308 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-6be58bcb-de68-4603-9772-79115b644636 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030" status: 200 len: 1366 microversion: 2.1 time: 0.346268 Jul 21 20:05:20.635113 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 46/76] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:20 2022] GET /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030 => generated 1366 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:20.856679 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-1d961ac5-4d7d-495b-b4b2-b7718f7ad599 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:20.857369 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-1d961ac5-4d7d-495b-b4b2-b7718f7ad599 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] [instance: 3c7c536b-2058-4226-938c-65ec0ad3dddc] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:20.863973 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-1d961ac5-4d7d-495b-b4b2-b7718f7ad599 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:20.864476 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-1d961ac5-4d7d-495b-b4b2-b7718f7ad599 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:20.866607 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-1d961ac5-4d7d-495b-b4b2-b7718f7ad599 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:20.866607 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-1d961ac5-4d7d-495b-b4b2-b7718f7ad599 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:20.924060 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-aea14101-f152-4fef-bae9-6601af1b16aa tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:20.924174 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-aea14101-f152-4fef-bae9-6601af1b16aa tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:20.930856 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-aea14101-f152-4fef-bae9-6601af1b16aa tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:20.931401 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-aea14101-f152-4fef-bae9-6601af1b16aa tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:20.932138 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-aea14101-f152-4fef-bae9-6601af1b16aa tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:20.932626 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-aea14101-f152-4fef-bae9-6601af1b16aa tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:21.005357 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-1d961ac5-4d7d-495b-b4b2-b7718f7ad599 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0100323b16c045b98dec585b9e59f077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc40ec656240410e862fde9531e0fc55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:21.012815 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-1d961ac5-4d7d-495b-b4b2-b7718f7ad599 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] 10.222.0.58 "GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc" status: 200 len: 1314 microversion: 2.1 time: 0.160027 Jul 21 20:05:21.013908 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 31/77] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:20 2022] GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:21.065208 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-aea14101-f152-4fef-bae9-6601af1b16aa tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:21.073023 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-aea14101-f152-4fef-bae9-6601af1b16aa tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a" status: 200 len: 1362 microversion: 2.1 time: 0.153535 Jul 21 20:05:21.073618 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 47/78] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:20 2022] GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:05:21.218301 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-06615bb6-ec12-4a48-a53b-b8deb96e92d8 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:21.218904 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-06615bb6-ec12-4a48-a53b-b8deb96e92d8 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 514a7771-fbf2-46db-9e3d-905a6a3e703d] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:21.224892 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-06615bb6-ec12-4a48-a53b-b8deb96e92d8 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:21.225329 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-06615bb6-ec12-4a48-a53b-b8deb96e92d8 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:21.226076 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-06615bb6-ec12-4a48-a53b-b8deb96e92d8 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:21.226500 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-06615bb6-ec12-4a48-a53b-b8deb96e92d8 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:21.366999 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-06615bb6-ec12-4a48-a53b-b8deb96e92d8 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:21.374642 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-06615bb6-ec12-4a48-a53b-b8deb96e92d8 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d" status: 200 len: 1321 microversion: 2.1 time: 0.160517 Jul 21 20:05:21.375279 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 32/79] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:21 2022] GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:05:21.571592 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [req-f81dbc16-bc24-42d1-938b-861e8b3ac367 req-e81ece70-2be5-4075-a891-0174d8ab5c19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f00566b-862b-4171-9259-b12aaa7ea030", "tag": "41ea78c8-2eb5-49db-9ee7-8b020833e0f8"}, {"name": "network-changed", "server_uuid": "514a7771-fbf2-46db-9e3d-905a6a3e703d", "tag": "fbb80a34-19c6-45c1-858e-6d36cec0a5b8"}]} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:05:21.580695 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-f81dbc16-bc24-42d1-938b-861e8b3ac367 req-e81ece70-2be5-4075-a891-0174d8ab5c19 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:21.581135 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-f81dbc16-bc24-42d1-938b-861e8b3ac367 req-e81ece70-2be5-4075-a891-0174d8ab5c19 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:21.593734 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.compute.server_external_events [req-f81dbc16-bc24-42d1-938b-861e8b3ac367 req-e81ece70-2be5-4075-a891-0174d8ab5c19 service nova] Creating event network-changed:41ea78c8-2eb5-49db-9ee7-8b020833e0f8 for instance 8f00566b-862b-4171-9259-b12aaa7ea030 on hv-cinder-85054 Jul 21 20:05:21.594238 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.compute.server_external_events [req-f81dbc16-bc24-42d1-938b-861e8b3ac367 req-e81ece70-2be5-4075-a891-0174d8ab5c19 service nova] Creating event network-changed:fbb80a34-19c6-45c1-858e-6d36cec0a5b8 for instance 514a7771-fbf2-46db-9e3d-905a6a3e703d on hv-cinder-85054 Jul 21 20:05:21.594793 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-a9b68ffc-f024-4373-9583-9c5c349af8eb tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:21.595569 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-a9b68ffc-f024-4373-9583-9c5c349af8eb tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:21.600749 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [req-f81dbc16-bc24-42d1-938b-861e8b3ac367 req-e81ece70-2be5-4075-a891-0174d8ab5c19 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.032885 Jul 21 20:05:21.601506 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 48/80] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 20:05:21 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:05:21.604324 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-a9b68ffc-f024-4373-9583-9c5c349af8eb tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:21.604971 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-a9b68ffc-f024-4373-9583-9c5c349af8eb tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:21.605938 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-a9b68ffc-f024-4373-9583-9c5c349af8eb tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:21.606395 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-a9b68ffc-f024-4373-9583-9c5c349af8eb tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:21.643427 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-327be8a0-fe61-4fac-8965-232dffb3523d tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:21.644962 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-327be8a0-fe61-4fac-8965-232dffb3523d tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 8f00566b-862b-4171-9259-b12aaa7ea030] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:21.654616 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-327be8a0-fe61-4fac-8965-232dffb3523d tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:21.660336 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-327be8a0-fe61-4fac-8965-232dffb3523d tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:21.660336 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-327be8a0-fe61-4fac-8965-232dffb3523d tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:21.660336 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-327be8a0-fe61-4fac-8965-232dffb3523d tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:21.760951 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-a9b68ffc-f024-4373-9583-9c5c349af8eb tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:21.769173 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-a9b68ffc-f024-4373-9583-9c5c349af8eb tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:21.770941 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-a9b68ffc-f024-4373-9583-9c5c349af8eb tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:21.772099 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-a9b68ffc-f024-4373-9583-9c5c349af8eb tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1406 microversion: 2.20 time: 0.181811 Jul 21 20:05:21.772666 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 33/81] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:05:21 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1406 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 20:05:21.801566 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-327be8a0-fe61-4fac-8965-232dffb3523d tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:21.808964 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-327be8a0-fe61-4fac-8965-232dffb3523d tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030" status: 200 len: 1366 microversion: 2.1 time: 0.171185 Jul 21 20:05:21.814741 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 49/82] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:21 2022] GET /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030 => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:22.031261 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-123d4e17-cf53-4a29-b913-46896dd4c4c0 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:22.031261 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-123d4e17-cf53-4a29-b913-46896dd4c4c0 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] [instance: 3c7c536b-2058-4226-938c-65ec0ad3dddc] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:22.037145 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-123d4e17-cf53-4a29-b913-46896dd4c4c0 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:22.037592 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-123d4e17-cf53-4a29-b913-46896dd4c4c0 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:22.038354 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-123d4e17-cf53-4a29-b913-46896dd4c4c0 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:22.038790 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-123d4e17-cf53-4a29-b913-46896dd4c4c0 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:22.090403 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-5cd62546-4275-4e43-bef3-b13ff110d6e8 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:22.091269 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-5cd62546-4275-4e43-bef3-b13ff110d6e8 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:22.098147 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5cd62546-4275-4e43-bef3-b13ff110d6e8 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:22.099256 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5cd62546-4275-4e43-bef3-b13ff110d6e8 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:22.100081 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5cd62546-4275-4e43-bef3-b13ff110d6e8 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:22.100671 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5cd62546-4275-4e43-bef3-b13ff110d6e8 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:22.185174 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-123d4e17-cf53-4a29-b913-46896dd4c4c0 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0100323b16c045b98dec585b9e59f077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc40ec656240410e862fde9531e0fc55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:22.193540 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-123d4e17-cf53-4a29-b913-46896dd4c4c0 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] 10.222.0.58 "GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc" status: 200 len: 1314 microversion: 2.1 time: 0.167689 Jul 21 20:05:22.203385 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 34/83] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:22 2022] GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:22.238370 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-5cd62546-4275-4e43-bef3-b13ff110d6e8 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:22.245737 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-5cd62546-4275-4e43-bef3-b13ff110d6e8 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a" status: 200 len: 1362 microversion: 2.1 time: 0.159175 Jul 21 20:05:22.246299 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 50/84] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:22 2022] GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:05:22.392470 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-ce68e413-8377-4a1d-b92b-e4064693cf32 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:22.393841 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-ce68e413-8377-4a1d-b92b-e4064693cf32 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 514a7771-fbf2-46db-9e3d-905a6a3e703d] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:22.396482 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG dbcounter [-] [118344] Writing DB stats nova_cell0:SELECT=30 {{(pid=118344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:05:22.403272 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-ce68e413-8377-4a1d-b92b-e4064693cf32 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:22.403853 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-ce68e413-8377-4a1d-b92b-e4064693cf32 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:22.417823 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-ce68e413-8377-4a1d-b92b-e4064693cf32 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:22.418443 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-ce68e413-8377-4a1d-b92b-e4064693cf32 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:22.589244 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-ce68e413-8377-4a1d-b92b-e4064693cf32 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:22.599094 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-ce68e413-8377-4a1d-b92b-e4064693cf32 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d" status: 200 len: 1321 microversion: 2.1 time: 0.210404 Jul 21 20:05:22.600328 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 35/85] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:22 2022] GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d => generated 1321 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:22.791109 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-0e031713-3d00-4d7f-8dcf-6ecadb51e4a0 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:22.791831 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-0e031713-3d00-4d7f-8dcf-6ecadb51e4a0 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:22.798364 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0e031713-3d00-4d7f-8dcf-6ecadb51e4a0 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:22.799588 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0e031713-3d00-4d7f-8dcf-6ecadb51e4a0 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:22.800096 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0e031713-3d00-4d7f-8dcf-6ecadb51e4a0 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:22.800660 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0e031713-3d00-4d7f-8dcf-6ecadb51e4a0 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:22.831116 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-1b44bc27-177b-4a84-bc8c-2f9ec37015fb tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:22.832613 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-1b44bc27-177b-4a84-bc8c-2f9ec37015fb tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 8f00566b-862b-4171-9259-b12aaa7ea030] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:22.839414 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-1b44bc27-177b-4a84-bc8c-2f9ec37015fb tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:22.846986 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-1b44bc27-177b-4a84-bc8c-2f9ec37015fb tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:22.846986 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-1b44bc27-177b-4a84-bc8c-2f9ec37015fb tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:22.846986 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-1b44bc27-177b-4a84-bc8c-2f9ec37015fb tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:22.988939 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-0e031713-3d00-4d7f-8dcf-6ecadb51e4a0 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:23.004598 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-0e031713-3d00-4d7f-8dcf-6ecadb51e4a0 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:23.006380 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-0e031713-3d00-4d7f-8dcf-6ecadb51e4a0 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:23.007820 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-0e031713-3d00-4d7f-8dcf-6ecadb51e4a0 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1406 microversion: 2.20 time: 0.221277 Jul 21 20:05:23.008917 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 51/86] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:05:22 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1406 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:05:23.017073 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-1b44bc27-177b-4a84-bc8c-2f9ec37015fb tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:23.021598 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG dbcounter [-] [118344] Writing DB stats nova_cell1:SELECT=100 {{(pid=118344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:05:23.026250 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-1b44bc27-177b-4a84-bc8c-2f9ec37015fb tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030" status: 200 len: 1366 microversion: 2.1 time: 0.199454 Jul 21 20:05:23.037607 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 36/87] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:22 2022] GET /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030 => generated 1366 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:05:23.211653 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-2d3e5761-dc7b-4872-94dc-705da93024c0 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:23.212317 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-2d3e5761-dc7b-4872-94dc-705da93024c0 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] [instance: 3c7c536b-2058-4226-938c-65ec0ad3dddc] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:23.219448 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2d3e5761-dc7b-4872-94dc-705da93024c0 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:23.219891 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2d3e5761-dc7b-4872-94dc-705da93024c0 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:23.220642 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2d3e5761-dc7b-4872-94dc-705da93024c0 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:23.221071 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2d3e5761-dc7b-4872-94dc-705da93024c0 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:23.262453 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-fc276d25-0d6f-4962-8b99-2a9ac665b113 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:23.263225 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-fc276d25-0d6f-4962-8b99-2a9ac665b113 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:23.271453 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-fc276d25-0d6f-4962-8b99-2a9ac665b113 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:23.272047 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-fc276d25-0d6f-4962-8b99-2a9ac665b113 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:23.273146 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-fc276d25-0d6f-4962-8b99-2a9ac665b113 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:23.273550 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-fc276d25-0d6f-4962-8b99-2a9ac665b113 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:23.378231 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-2d3e5761-dc7b-4872-94dc-705da93024c0 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0100323b16c045b98dec585b9e59f077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc40ec656240410e862fde9531e0fc55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:23.392754 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-2d3e5761-dc7b-4872-94dc-705da93024c0 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] 10.222.0.58 "GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc" status: 200 len: 1314 microversion: 2.1 time: 0.184904 Jul 21 20:05:23.393456 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 52/88] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:23 2022] GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:23.437761 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-fc276d25-0d6f-4962-8b99-2a9ac665b113 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:23.460256 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-fc276d25-0d6f-4962-8b99-2a9ac665b113 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a" status: 200 len: 1362 microversion: 2.1 time: 0.201617 Jul 21 20:05:23.461779 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 37/89] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:23 2022] GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a => generated 1362 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:05:23.617838 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-4aa71296-25a4-4678-9ffe-1653e28afc86 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:23.618447 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-4aa71296-25a4-4678-9ffe-1653e28afc86 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 514a7771-fbf2-46db-9e3d-905a6a3e703d] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:23.625342 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4aa71296-25a4-4678-9ffe-1653e28afc86 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:23.625717 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4aa71296-25a4-4678-9ffe-1653e28afc86 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:23.626492 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4aa71296-25a4-4678-9ffe-1653e28afc86 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:23.626927 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4aa71296-25a4-4678-9ffe-1653e28afc86 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:23.776402 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-4aa71296-25a4-4678-9ffe-1653e28afc86 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:23.784210 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-4aa71296-25a4-4678-9ffe-1653e28afc86 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d" status: 200 len: 1321 microversion: 2.1 time: 0.170363 Jul 21 20:05:23.784899 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 53/90] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:23 2022] GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d => generated 1321 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:24.026755 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-e1cbdf7f-3b4e-41e5-99eb-3486d4e94066 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:24.027400 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-e1cbdf7f-3b4e-41e5-99eb-3486d4e94066 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:24.033914 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-e1cbdf7f-3b4e-41e5-99eb-3486d4e94066 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:24.034365 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-e1cbdf7f-3b4e-41e5-99eb-3486d4e94066 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:24.035173 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-e1cbdf7f-3b4e-41e5-99eb-3486d4e94066 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:24.035611 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-e1cbdf7f-3b4e-41e5-99eb-3486d4e94066 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:24.045024 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-91d81763-c41b-4b1f-beab-658bca8e58ce tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:24.045640 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-91d81763-c41b-4b1f-beab-658bca8e58ce tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 8f00566b-862b-4171-9259-b12aaa7ea030] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:24.052007 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-91d81763-c41b-4b1f-beab-658bca8e58ce tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:24.052454 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-91d81763-c41b-4b1f-beab-658bca8e58ce tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:24.053316 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-91d81763-c41b-4b1f-beab-658bca8e58ce tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:24.053756 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-91d81763-c41b-4b1f-beab-658bca8e58ce tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:24.177462 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-e1cbdf7f-3b4e-41e5-99eb-3486d4e94066 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:24.185467 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-e1cbdf7f-3b4e-41e5-99eb-3486d4e94066 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:24.186939 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-e1cbdf7f-3b4e-41e5-99eb-3486d4e94066 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:24.188070 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-e1cbdf7f-3b4e-41e5-99eb-3486d4e94066 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1406 microversion: 2.20 time: 0.165641 Jul 21 20:05:24.188345 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-91d81763-c41b-4b1f-beab-658bca8e58ce tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:24.188629 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 38/91] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:05:24 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:05:24.197136 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-91d81763-c41b-4b1f-beab-658bca8e58ce tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030" status: 200 len: 1366 microversion: 2.1 time: 0.156247 Jul 21 20:05:24.197709 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 54/92] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:24 2022] GET /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:05:24.409891 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-9ab6eb1d-a639-47cb-a63d-5ac28562bc21 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:24.410424 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-9ab6eb1d-a639-47cb-a63d-5ac28562bc21 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] [instance: 3c7c536b-2058-4226-938c-65ec0ad3dddc] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:24.416638 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-9ab6eb1d-a639-47cb-a63d-5ac28562bc21 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:24.417088 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-9ab6eb1d-a639-47cb-a63d-5ac28562bc21 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:24.424850 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-9ab6eb1d-a639-47cb-a63d-5ac28562bc21 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:24.424850 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-9ab6eb1d-a639-47cb-a63d-5ac28562bc21 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:24.478470 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-a8051e8c-895f-4bb2-b230-903fa0b772d2 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:24.479118 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-a8051e8c-895f-4bb2-b230-903fa0b772d2 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:24.485155 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a8051e8c-895f-4bb2-b230-903fa0b772d2 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:24.485604 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a8051e8c-895f-4bb2-b230-903fa0b772d2 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:24.486365 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a8051e8c-895f-4bb2-b230-903fa0b772d2 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:24.486800 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a8051e8c-895f-4bb2-b230-903fa0b772d2 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:24.565674 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-9ab6eb1d-a639-47cb-a63d-5ac28562bc21 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0100323b16c045b98dec585b9e59f077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc40ec656240410e862fde9531e0fc55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:24.574135 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-9ab6eb1d-a639-47cb-a63d-5ac28562bc21 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] 10.222.0.58 "GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc" status: 200 len: 1314 microversion: 2.1 time: 0.168188 Jul 21 20:05:24.574715 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 39/93] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:24 2022] GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:24.643203 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-a8051e8c-895f-4bb2-b230-903fa0b772d2 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:24.651704 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-a8051e8c-895f-4bb2-b230-903fa0b772d2 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a" status: 200 len: 1362 microversion: 2.1 time: 0.177219 Jul 21 20:05:24.656772 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 55/94] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:24 2022] GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a => generated 1362 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:05:24.801115 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-97927ed9-e72c-4518-a207-c8573ef71540 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:24.801980 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-97927ed9-e72c-4518-a207-c8573ef71540 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 514a7771-fbf2-46db-9e3d-905a6a3e703d] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:24.808405 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-97927ed9-e72c-4518-a207-c8573ef71540 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:24.808850 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-97927ed9-e72c-4518-a207-c8573ef71540 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:24.809623 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-97927ed9-e72c-4518-a207-c8573ef71540 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:24.810082 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-97927ed9-e72c-4518-a207-c8573ef71540 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:24.960154 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-97927ed9-e72c-4518-a207-c8573ef71540 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:24.969144 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-97927ed9-e72c-4518-a207-c8573ef71540 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d" status: 200 len: 1321 microversion: 2.1 time: 0.171971 Jul 21 20:05:24.969831 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 40/95] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:24 2022] GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d => generated 1321 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:25.207157 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-38c6eccd-a610-41b2-b0f8-06862f002d98 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:25.207810 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-38c6eccd-a610-41b2-b0f8-06862f002d98 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:25.214398 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-38c6eccd-a610-41b2-b0f8-06862f002d98 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:25.214852 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-38c6eccd-a610-41b2-b0f8-06862f002d98 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:25.215661 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-38c6eccd-a610-41b2-b0f8-06862f002d98 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:25.219694 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-38c6eccd-a610-41b2-b0f8-06862f002d98 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:25.222579 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-bc135e85-68cc-4dc7-a520-30368e6d66ae tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:25.223423 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-bc135e85-68cc-4dc7-a520-30368e6d66ae tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 8f00566b-862b-4171-9259-b12aaa7ea030] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:25.231124 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-bc135e85-68cc-4dc7-a520-30368e6d66ae tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:25.231560 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-bc135e85-68cc-4dc7-a520-30368e6d66ae tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:25.232356 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-bc135e85-68cc-4dc7-a520-30368e6d66ae tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:25.232985 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-bc135e85-68cc-4dc7-a520-30368e6d66ae tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:25.236846 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell1:SELECT=100 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:05:25.371330 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-38c6eccd-a610-41b2-b0f8-06862f002d98 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:25.376338 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-bc135e85-68cc-4dc7-a520-30368e6d66ae tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:25.379927 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-38c6eccd-a610-41b2-b0f8-06862f002d98 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:25.381717 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-38c6eccd-a610-41b2-b0f8-06862f002d98 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:25.382836 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-38c6eccd-a610-41b2-b0f8-06862f002d98 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1406 microversion: 2.20 time: 0.179699 Jul 21 20:05:25.393427 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-bc135e85-68cc-4dc7-a520-30368e6d66ae tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030" status: 200 len: 1366 microversion: 2.1 time: 0.167305 Jul 21 20:05:25.393427 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 41/96] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:25 2022] GET /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030 => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:25.394711 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 56/97] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:05:25 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1406 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:05:25.592337 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-44fcf64d-9b27-4099-89c5-57bcc7d9fc4b tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:25.593000 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-44fcf64d-9b27-4099-89c5-57bcc7d9fc4b tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] [instance: 3c7c536b-2058-4226-938c-65ec0ad3dddc] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:25.600172 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-44fcf64d-9b27-4099-89c5-57bcc7d9fc4b tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:25.600626 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-44fcf64d-9b27-4099-89c5-57bcc7d9fc4b tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:25.601413 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-44fcf64d-9b27-4099-89c5-57bcc7d9fc4b tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:25.602210 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-44fcf64d-9b27-4099-89c5-57bcc7d9fc4b tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:25.669691 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-afd14562-3411-4637-bb45-1cbf57c7ac4b tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:25.670306 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-afd14562-3411-4637-bb45-1cbf57c7ac4b tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:25.684644 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-afd14562-3411-4637-bb45-1cbf57c7ac4b tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:25.685110 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-afd14562-3411-4637-bb45-1cbf57c7ac4b tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:25.685887 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-afd14562-3411-4637-bb45-1cbf57c7ac4b tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:25.686321 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-afd14562-3411-4637-bb45-1cbf57c7ac4b tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:25.749110 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-44fcf64d-9b27-4099-89c5-57bcc7d9fc4b tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0100323b16c045b98dec585b9e59f077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc40ec656240410e862fde9531e0fc55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:25.757452 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-44fcf64d-9b27-4099-89c5-57bcc7d9fc4b tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] 10.222.0.58 "GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc" status: 200 len: 1314 microversion: 2.1 time: 0.169611 Jul 21 20:05:25.758162 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 42/98] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:25 2022] GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:25.830171 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-afd14562-3411-4637-bb45-1cbf57c7ac4b tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:25.838249 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-afd14562-3411-4637-bb45-1cbf57c7ac4b tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a" status: 200 len: 1362 microversion: 2.1 time: 0.172472 Jul 21 20:05:25.838804 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 57/99] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:25 2022] GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:05:25.984927 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-3cdf5e1c-5b5d-462c-850a-e5027cbd5520 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:25.985540 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-3cdf5e1c-5b5d-462c-850a-e5027cbd5520 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 514a7771-fbf2-46db-9e3d-905a6a3e703d] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:25.992180 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-3cdf5e1c-5b5d-462c-850a-e5027cbd5520 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:25.992626 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-3cdf5e1c-5b5d-462c-850a-e5027cbd5520 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:25.993721 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-3cdf5e1c-5b5d-462c-850a-e5027cbd5520 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:25.993833 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-3cdf5e1c-5b5d-462c-850a-e5027cbd5520 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:26.149290 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-3cdf5e1c-5b5d-462c-850a-e5027cbd5520 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:26.157800 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-3cdf5e1c-5b5d-462c-850a-e5027cbd5520 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d" status: 200 len: 1321 microversion: 2.1 time: 0.176563 Jul 21 20:05:26.158403 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 43/100] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:25 2022] GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d => generated 1321 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:26.401653 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-c3b8e800-4626-47a2-9c6c-1b8c071ebadd tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:26.402540 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-c3b8e800-4626-47a2-9c6c-1b8c071ebadd tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:26.402659 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-7eb10040-f43e-4dd3-a1b2-0dcd15da40df tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:26.403181 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-7eb10040-f43e-4dd3-a1b2-0dcd15da40df tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 8f00566b-862b-4171-9259-b12aaa7ea030] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:26.408840 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c3b8e800-4626-47a2-9c6c-1b8c071ebadd tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:26.409062 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-7eb10040-f43e-4dd3-a1b2-0dcd15da40df tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:26.409280 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c3b8e800-4626-47a2-9c6c-1b8c071ebadd tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:26.409513 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-7eb10040-f43e-4dd3-a1b2-0dcd15da40df tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:26.410783 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c3b8e800-4626-47a2-9c6c-1b8c071ebadd tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:26.410898 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-7eb10040-f43e-4dd3-a1b2-0dcd15da40df tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:26.411288 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c3b8e800-4626-47a2-9c6c-1b8c071ebadd tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:26.411391 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-7eb10040-f43e-4dd3-a1b2-0dcd15da40df tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:26.548677 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-7eb10040-f43e-4dd3-a1b2-0dcd15da40df tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:26.557390 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-7eb10040-f43e-4dd3-a1b2-0dcd15da40df tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030" status: 200 len: 1366 microversion: 2.1 time: 0.158579 Jul 21 20:05:26.558178 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 44/101] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:26 2022] GET /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:05:26.583214 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-c3b8e800-4626-47a2-9c6c-1b8c071ebadd tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:26.591368 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-c3b8e800-4626-47a2-9c6c-1b8c071ebadd tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:26.592871 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-c3b8e800-4626-47a2-9c6c-1b8c071ebadd tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:26.594001 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-c3b8e800-4626-47a2-9c6c-1b8c071ebadd tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1406 microversion: 2.20 time: 0.196680 Jul 21 20:05:26.594552 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 58/102] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:05:26 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1406 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:05:26.777895 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-6a255a12-7c6d-423e-925d-e20eb9b7cabe tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:26.778511 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-6a255a12-7c6d-423e-925d-e20eb9b7cabe tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] [instance: 3c7c536b-2058-4226-938c-65ec0ad3dddc] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:26.785080 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-6a255a12-7c6d-423e-925d-e20eb9b7cabe tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:26.785546 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-6a255a12-7c6d-423e-925d-e20eb9b7cabe tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:26.786566 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-6a255a12-7c6d-423e-925d-e20eb9b7cabe tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:26.787176 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-6a255a12-7c6d-423e-925d-e20eb9b7cabe tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:26.855431 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-078dc1ea-b502-4b47-bfc4-c5ae9a362eea tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:26.856110 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-078dc1ea-b502-4b47-bfc4-c5ae9a362eea tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:26.862341 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-078dc1ea-b502-4b47-bfc4-c5ae9a362eea tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:26.863331 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-078dc1ea-b502-4b47-bfc4-c5ae9a362eea tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:26.864087 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-078dc1ea-b502-4b47-bfc4-c5ae9a362eea tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:26.864512 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-078dc1ea-b502-4b47-bfc4-c5ae9a362eea tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:26.944789 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-6a255a12-7c6d-423e-925d-e20eb9b7cabe tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0100323b16c045b98dec585b9e59f077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc40ec656240410e862fde9531e0fc55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:26.952319 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-6a255a12-7c6d-423e-925d-e20eb9b7cabe tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] 10.222.0.58 "GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc" status: 200 len: 1314 microversion: 2.1 time: 0.178375 Jul 21 20:05:26.952931 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 45/103] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:26 2022] GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:27.015251 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-078dc1ea-b502-4b47-bfc4-c5ae9a362eea tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:27.024173 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-078dc1ea-b502-4b47-bfc4-c5ae9a362eea tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a" status: 200 len: 1362 microversion: 2.1 time: 0.172521 Jul 21 20:05:27.024755 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 59/104] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:26 2022] GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:05:27.176966 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-1ba87942-bfea-4413-9e26-7ac2c45f1f7f tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:27.186575 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-1ba87942-bfea-4413-9e26-7ac2c45f1f7f tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 514a7771-fbf2-46db-9e3d-905a6a3e703d] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:27.186575 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-1ba87942-bfea-4413-9e26-7ac2c45f1f7f tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:27.186575 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-1ba87942-bfea-4413-9e26-7ac2c45f1f7f tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:27.186575 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-1ba87942-bfea-4413-9e26-7ac2c45f1f7f tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:27.187213 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-1ba87942-bfea-4413-9e26-7ac2c45f1f7f tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:27.316873 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-1ba87942-bfea-4413-9e26-7ac2c45f1f7f tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:27.324342 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-1ba87942-bfea-4413-9e26-7ac2c45f1f7f tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d" status: 200 len: 1321 microversion: 2.1 time: 0.151165 Jul 21 20:05:27.324961 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 46/105] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:27 2022] GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:27.574732 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-e972dd2e-0fb1-4d69-b072-56007451c318 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:27.575400 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-e972dd2e-0fb1-4d69-b072-56007451c318 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 8f00566b-862b-4171-9259-b12aaa7ea030] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:27.581508 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e972dd2e-0fb1-4d69-b072-56007451c318 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:27.581958 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e972dd2e-0fb1-4d69-b072-56007451c318 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:27.582721 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e972dd2e-0fb1-4d69-b072-56007451c318 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:27.583196 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e972dd2e-0fb1-4d69-b072-56007451c318 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:27.616267 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-fce3abbf-dc0f-4113-b5a0-e5ca041c6e1d tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:27.616875 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-fce3abbf-dc0f-4113-b5a0-e5ca041c6e1d tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:27.623782 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-fce3abbf-dc0f-4113-b5a0-e5ca041c6e1d tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:27.624258 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-fce3abbf-dc0f-4113-b5a0-e5ca041c6e1d tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:27.625037 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-fce3abbf-dc0f-4113-b5a0-e5ca041c6e1d tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:27.625524 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-fce3abbf-dc0f-4113-b5a0-e5ca041c6e1d tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:27.727119 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-e972dd2e-0fb1-4d69-b072-56007451c318 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:27.735132 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-e972dd2e-0fb1-4d69-b072-56007451c318 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030" status: 200 len: 1366 microversion: 2.1 time: 0.164113 Jul 21 20:05:27.735869 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 60/106] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:27 2022] GET /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:27.772541 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-fce3abbf-dc0f-4113-b5a0-e5ca041c6e1d tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:27.780457 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-fce3abbf-dc0f-4113-b5a0-e5ca041c6e1d tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:27.782019 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-fce3abbf-dc0f-4113-b5a0-e5ca041c6e1d tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:27.783739 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-fce3abbf-dc0f-4113-b5a0-e5ca041c6e1d tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1406 microversion: 2.20 time: 0.174926 Jul 21 20:05:27.784297 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 47/107] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:05:27 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1406 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:05:27.970387 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-96eca7c1-3745-4b84-abcf-7ec652e7a791 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:27.970996 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-96eca7c1-3745-4b84-abcf-7ec652e7a791 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] [instance: 3c7c536b-2058-4226-938c-65ec0ad3dddc] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:27.977168 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-96eca7c1-3745-4b84-abcf-7ec652e7a791 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:27.977614 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-96eca7c1-3745-4b84-abcf-7ec652e7a791 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:27.978372 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-96eca7c1-3745-4b84-abcf-7ec652e7a791 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:27.978802 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-96eca7c1-3745-4b84-abcf-7ec652e7a791 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:28.041058 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-6f4e26b0-7d4a-4340-b019-5c2c1764b195 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:28.041663 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-6f4e26b0-7d4a-4340-b019-5c2c1764b195 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:28.049319 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-6f4e26b0-7d4a-4340-b019-5c2c1764b195 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:28.053402 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-6f4e26b0-7d4a-4340-b019-5c2c1764b195 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:28.053402 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-6f4e26b0-7d4a-4340-b019-5c2c1764b195 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:28.053402 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-6f4e26b0-7d4a-4340-b019-5c2c1764b195 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:28.129875 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-96eca7c1-3745-4b84-abcf-7ec652e7a791 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0100323b16c045b98dec585b9e59f077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc40ec656240410e862fde9531e0fc55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:28.138106 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-96eca7c1-3745-4b84-abcf-7ec652e7a791 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] 10.222.0.58 "GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc" status: 200 len: 1314 microversion: 2.1 time: 0.171917 Jul 21 20:05:28.139221 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 61/108] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:27 2022] GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:28.206346 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-6f4e26b0-7d4a-4340-b019-5c2c1764b195 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:28.214729 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-6f4e26b0-7d4a-4340-b019-5c2c1764b195 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a" status: 200 len: 1362 microversion: 2.1 time: 0.177505 Jul 21 20:05:28.215431 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 48/109] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:28 2022] GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a => generated 1362 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:28.341528 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-17c622fc-1edf-4c10-b2c0-bbb3ee509f3a tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:28.343370 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-17c622fc-1edf-4c10-b2c0-bbb3ee509f3a tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 514a7771-fbf2-46db-9e3d-905a6a3e703d] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:28.348971 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-17c622fc-1edf-4c10-b2c0-bbb3ee509f3a tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:28.349412 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-17c622fc-1edf-4c10-b2c0-bbb3ee509f3a tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:28.350172 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-17c622fc-1edf-4c10-b2c0-bbb3ee509f3a tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:28.350606 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-17c622fc-1edf-4c10-b2c0-bbb3ee509f3a tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:28.482224 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-17c622fc-1edf-4c10-b2c0-bbb3ee509f3a tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:28.489571 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-17c622fc-1edf-4c10-b2c0-bbb3ee509f3a tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d" status: 200 len: 1321 microversion: 2.1 time: 0.152158 Jul 21 20:05:28.490132 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 62/110] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:28 2022] GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:28.752045 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-e391f874-02b8-4ad1-9d4c-9151daac8a06 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:28.752694 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-e391f874-02b8-4ad1-9d4c-9151daac8a06 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 8f00566b-862b-4171-9259-b12aaa7ea030] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:28.755089 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG dbcounter [-] [118344] Writing DB stats nova_cell0:SELECT=8 {{(pid=118344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:05:28.759997 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-e391f874-02b8-4ad1-9d4c-9151daac8a06 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:28.760440 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-e391f874-02b8-4ad1-9d4c-9151daac8a06 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:28.761204 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-e391f874-02b8-4ad1-9d4c-9151daac8a06 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:28.761637 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-e391f874-02b8-4ad1-9d4c-9151daac8a06 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:28.801311 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-7aacf155-6657-4bb1-a962-b9acfeeec01d tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:28.802061 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-7aacf155-6657-4bb1-a962-b9acfeeec01d tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:28.808584 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-7aacf155-6657-4bb1-a962-b9acfeeec01d tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:28.809032 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-7aacf155-6657-4bb1-a962-b9acfeeec01d tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:28.809811 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-7aacf155-6657-4bb1-a962-b9acfeeec01d tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:28.810351 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-7aacf155-6657-4bb1-a962-b9acfeeec01d tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:28.890470 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-e391f874-02b8-4ad1-9d4c-9151daac8a06 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:28.898473 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-e391f874-02b8-4ad1-9d4c-9151daac8a06 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030" status: 200 len: 1366 microversion: 2.1 time: 0.150367 Jul 21 20:05:28.899073 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 49/111] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:28 2022] GET /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:28.940543 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-7aacf155-6657-4bb1-a962-b9acfeeec01d tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:28.948664 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-7aacf155-6657-4bb1-a962-b9acfeeec01d tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:28.950194 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-7aacf155-6657-4bb1-a962-b9acfeeec01d tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:28.951333 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-7aacf155-6657-4bb1-a962-b9acfeeec01d tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1406 microversion: 2.20 time: 0.153929 Jul 21 20:05:28.952093 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 63/112] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:05:28 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 20:05:29.157456 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-75c14095-3ac6-4aa8-a268-dbc7ed02593e tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:29.158848 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-75c14095-3ac6-4aa8-a268-dbc7ed02593e tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] [instance: 3c7c536b-2058-4226-938c-65ec0ad3dddc] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:29.167890 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-75c14095-3ac6-4aa8-a268-dbc7ed02593e tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:29.168801 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-75c14095-3ac6-4aa8-a268-dbc7ed02593e tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:29.170243 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-75c14095-3ac6-4aa8-a268-dbc7ed02593e tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:29.170903 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-75c14095-3ac6-4aa8-a268-dbc7ed02593e tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:29.232699 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-1dde8689-d73a-44c7-bed8-fb08a09a91e7 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:29.233319 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-1dde8689-d73a-44c7-bed8-fb08a09a91e7 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:29.240437 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1dde8689-d73a-44c7-bed8-fb08a09a91e7 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:29.240893 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1dde8689-d73a-44c7-bed8-fb08a09a91e7 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:29.241682 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1dde8689-d73a-44c7-bed8-fb08a09a91e7 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:29.242117 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1dde8689-d73a-44c7-bed8-fb08a09a91e7 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:29.497029 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-1dde8689-d73a-44c7-bed8-fb08a09a91e7 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:29.502243 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell0:SELECT=2 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:05:29.507369 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-1dde8689-d73a-44c7-bed8-fb08a09a91e7 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a" status: 200 len: 1362 microversion: 2.1 time: 0.278439 Jul 21 20:05:29.510604 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 64/113] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:29 2022] GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a => generated 1362 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:05:29.512757 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-3d6d92c2-08a1-4c94-bb90-640f2d02edfe tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:29.513358 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-3d6d92c2-08a1-4c94-bb90-640f2d02edfe tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 514a7771-fbf2-46db-9e3d-905a6a3e703d] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:29.519414 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3d6d92c2-08a1-4c94-bb90-640f2d02edfe tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:29.519862 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3d6d92c2-08a1-4c94-bb90-640f2d02edfe tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:29.520617 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3d6d92c2-08a1-4c94-bb90-640f2d02edfe tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:29.521175 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3d6d92c2-08a1-4c94-bb90-640f2d02edfe tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:29.570124 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-75c14095-3ac6-4aa8-a268-dbc7ed02593e tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0100323b16c045b98dec585b9e59f077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc40ec656240410e862fde9531e0fc55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:29.577724 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-75c14095-3ac6-4aa8-a268-dbc7ed02593e tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] 10.222.0.58 "GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc" status: 200 len: 1314 microversion: 2.1 time: 0.425621 Jul 21 20:05:29.578318 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 50/114] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:29 2022] GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc => generated 1314 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:29.692018 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-3d6d92c2-08a1-4c94-bb90-640f2d02edfe tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:29.699561 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-3d6d92c2-08a1-4c94-bb90-640f2d02edfe tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d" status: 200 len: 1321 microversion: 2.1 time: 0.190500 Jul 21 20:05:29.700141 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 65/115] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:29 2022] GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d => generated 1321 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:29.915611 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-88feaf04-b1dd-4e42-822d-58b6069e9af0 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:29.916222 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-88feaf04-b1dd-4e42-822d-58b6069e9af0 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 8f00566b-862b-4171-9259-b12aaa7ea030] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:29.925779 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-88feaf04-b1dd-4e42-822d-58b6069e9af0 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:29.926229 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-88feaf04-b1dd-4e42-822d-58b6069e9af0 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:29.927013 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-88feaf04-b1dd-4e42-822d-58b6069e9af0 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:29.927471 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-88feaf04-b1dd-4e42-822d-58b6069e9af0 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:29.970696 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-f6bce069-6af5-4dc7-af73-e1432fc1b218 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:29.971925 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-f6bce069-6af5-4dc7-af73-e1432fc1b218 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:29.979523 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f6bce069-6af5-4dc7-af73-e1432fc1b218 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:29.980259 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f6bce069-6af5-4dc7-af73-e1432fc1b218 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:29.981140 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f6bce069-6af5-4dc7-af73-e1432fc1b218 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:29.981686 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f6bce069-6af5-4dc7-af73-e1432fc1b218 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:30.160225 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-88feaf04-b1dd-4e42-822d-58b6069e9af0 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:30.169839 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-88feaf04-b1dd-4e42-822d-58b6069e9af0 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030" status: 200 len: 1366 microversion: 2.1 time: 0.257851 Jul 21 20:05:30.170751 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 51/116] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:29 2022] GET /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030 => generated 1366 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:30.176862 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [req-63654a2a-aff0-41c2-a5fa-aad2ce4679eb req-ef4b9ddb-6f3a-4026-8a3c-2f05c426ee3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a", "tag": "4ee28e4e-c490-4447-b3bb-8dbba6042538"}]} {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:05:30.202390 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [req-63654a2a-aff0-41c2-a5fa-aad2ce4679eb req-ef4b9ddb-6f3a-4026-8a3c-2f05c426ee3e service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:30.203000 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [req-63654a2a-aff0-41c2-a5fa-aad2ce4679eb req-ef4b9ddb-6f3a-4026-8a3c-2f05c426ee3e service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:30.223381 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.compute.server_external_events [req-63654a2a-aff0-41c2-a5fa-aad2ce4679eb req-ef4b9ddb-6f3a-4026-8a3c-2f05c426ee3e service nova] Creating event network-changed:4ee28e4e-c490-4447-b3bb-8dbba6042538 for instance 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a on hv-cinder-85054 Jul 21 20:05:30.229696 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-f6bce069-6af5-4dc7-af73-e1432fc1b218 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:30.231137 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [req-63654a2a-aff0-41c2-a5fa-aad2ce4679eb req-ef4b9ddb-6f3a-4026-8a3c-2f05c426ee3e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057032 Jul 21 20:05:30.232154 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 52/117] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 20:05:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:05:30.241369 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-f6bce069-6af5-4dc7-af73-e1432fc1b218 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:30.245704 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-f6bce069-6af5-4dc7-af73-e1432fc1b218 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:30.248661 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-f6bce069-6af5-4dc7-af73-e1432fc1b218 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1406 microversion: 2.20 time: 0.282826 Jul 21 20:05:30.249752 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 66/118] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:05:29 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1406 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 20:05:30.270943 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [req-fe5dfedf-5509-4e6e-a89a-d892ff795ada req-ce1455ac-77ed-4aa3-a8dd-c19c32fc3332 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b07e385b-3d8f-4370-a8fc-013a1c785c0f", "tag": "b6f7db3f-a2e0-4b71-a01c-2b805c7bf070"}]} {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:05:30.279842 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [req-fe5dfedf-5509-4e6e-a89a-d892ff795ada req-ce1455ac-77ed-4aa3-a8dd-c19c32fc3332 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:30.280291 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [req-fe5dfedf-5509-4e6e-a89a-d892ff795ada req-ce1455ac-77ed-4aa3-a8dd-c19c32fc3332 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:30.294225 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.compute.server_external_events [req-fe5dfedf-5509-4e6e-a89a-d892ff795ada req-ce1455ac-77ed-4aa3-a8dd-c19c32fc3332 service nova] Creating event network-changed:b6f7db3f-a2e0-4b71-a01c-2b805c7bf070 for instance b07e385b-3d8f-4370-a8fc-013a1c785c0f on hv-cinder-85054 Jul 21 20:05:30.303572 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [req-fe5dfedf-5509-4e6e-a89a-d892ff795ada req-ce1455ac-77ed-4aa3-a8dd-c19c32fc3332 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031858 Jul 21 20:05:30.303572 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 53/119] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 20:05:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:05:30.524944 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-59f56d42-1421-42aa-afb2-c2f2385565c3 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:30.525546 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-59f56d42-1421-42aa-afb2-c2f2385565c3 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:30.531598 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-59f56d42-1421-42aa-afb2-c2f2385565c3 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:30.532033 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-59f56d42-1421-42aa-afb2-c2f2385565c3 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:30.532774 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-59f56d42-1421-42aa-afb2-c2f2385565c3 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:30.533222 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-59f56d42-1421-42aa-afb2-c2f2385565c3 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:30.594624 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-0ceb6888-a4ac-4355-b48c-da1941f67d3e tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:30.595273 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-0ceb6888-a4ac-4355-b48c-da1941f67d3e tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] [instance: 3c7c536b-2058-4226-938c-65ec0ad3dddc] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:30.601513 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-0ceb6888-a4ac-4355-b48c-da1941f67d3e tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:30.602106 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-0ceb6888-a4ac-4355-b48c-da1941f67d3e tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:30.602874 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-0ceb6888-a4ac-4355-b48c-da1941f67d3e tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:30.603339 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-0ceb6888-a4ac-4355-b48c-da1941f67d3e tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:30.666354 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-59f56d42-1421-42aa-afb2-c2f2385565c3 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:30.673816 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-59f56d42-1421-42aa-afb2-c2f2385565c3 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a" status: 200 len: 1362 microversion: 2.1 time: 0.152704 Jul 21 20:05:30.674390 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 67/120] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:30 2022] GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:30.718270 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-10476ad3-dfa6-407e-8985-aea9e89ffe61 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:30.718905 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-10476ad3-dfa6-407e-8985-aea9e89ffe61 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 514a7771-fbf2-46db-9e3d-905a6a3e703d] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:30.726101 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-10476ad3-dfa6-407e-8985-aea9e89ffe61 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:30.726538 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-10476ad3-dfa6-407e-8985-aea9e89ffe61 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:30.727337 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-10476ad3-dfa6-407e-8985-aea9e89ffe61 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:30.727786 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-10476ad3-dfa6-407e-8985-aea9e89ffe61 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:30.740901 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-0ceb6888-a4ac-4355-b48c-da1941f67d3e tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0100323b16c045b98dec585b9e59f077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc40ec656240410e862fde9531e0fc55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:30.744430 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG dbcounter [-] [118344] Writing DB stats nova_cell1:SELECT=100 {{(pid=118344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:05:30.748806 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-0ceb6888-a4ac-4355-b48c-da1941f67d3e tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] 10.222.0.58 "GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc" status: 200 len: 1314 microversion: 2.1 time: 0.158834 Jul 21 20:05:30.749695 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 54/121] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:30 2022] GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:05:30.855706 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-10476ad3-dfa6-407e-8985-aea9e89ffe61 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:30.863735 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-10476ad3-dfa6-407e-8985-aea9e89ffe61 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d" status: 200 len: 1321 microversion: 2.1 time: 0.150238 Jul 21 20:05:30.864306 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 68/122] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:30 2022] GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:31.187671 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-bc9eb747-0792-41cc-969d-43974f90fb6f tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:31.188282 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-bc9eb747-0792-41cc-969d-43974f90fb6f tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 8f00566b-862b-4171-9259-b12aaa7ea030] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:31.195108 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-bc9eb747-0792-41cc-969d-43974f90fb6f tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:31.195553 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-bc9eb747-0792-41cc-969d-43974f90fb6f tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:31.196313 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-bc9eb747-0792-41cc-969d-43974f90fb6f tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:31.196743 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-bc9eb747-0792-41cc-969d-43974f90fb6f tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:31.265698 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-c462bf85-9656-438c-b4fd-86d44b9c551a tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:31.266293 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-c462bf85-9656-438c-b4fd-86d44b9c551a tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:31.274151 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c462bf85-9656-438c-b4fd-86d44b9c551a tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:31.274796 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c462bf85-9656-438c-b4fd-86d44b9c551a tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:31.277633 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c462bf85-9656-438c-b4fd-86d44b9c551a tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:31.277633 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c462bf85-9656-438c-b4fd-86d44b9c551a tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:31.338353 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-bc9eb747-0792-41cc-969d-43974f90fb6f tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:31.346434 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-bc9eb747-0792-41cc-969d-43974f90fb6f tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030" status: 200 len: 1366 microversion: 2.1 time: 0.162953 Jul 21 20:05:31.352741 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 55/123] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:31 2022] GET /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030 => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:31.405518 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-c462bf85-9656-438c-b4fd-86d44b9c551a tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:31.413529 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-c462bf85-9656-438c-b4fd-86d44b9c551a tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:31.414987 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-c462bf85-9656-438c-b4fd-86d44b9c551a tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:31.416122 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-c462bf85-9656-438c-b4fd-86d44b9c551a tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1406 microversion: 2.20 time: 0.154323 Jul 21 20:05:31.416673 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 69/124] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:05:31 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 20:05:31.691957 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-14d4c9b8-1647-4caf-b344-ddfde52a676f tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:31.692513 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-14d4c9b8-1647-4caf-b344-ddfde52a676f tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:31.698604 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-14d4c9b8-1647-4caf-b344-ddfde52a676f tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:31.699083 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-14d4c9b8-1647-4caf-b344-ddfde52a676f tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:31.699845 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-14d4c9b8-1647-4caf-b344-ddfde52a676f tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:31.700277 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-14d4c9b8-1647-4caf-b344-ddfde52a676f tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:31.765808 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-a8dc309b-0c9d-4e40-b0f6-313b0692e3c4 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:31.766561 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-a8dc309b-0c9d-4e40-b0f6-313b0692e3c4 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] [instance: 3c7c536b-2058-4226-938c-65ec0ad3dddc] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:31.773229 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a8dc309b-0c9d-4e40-b0f6-313b0692e3c4 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:31.773756 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a8dc309b-0c9d-4e40-b0f6-313b0692e3c4 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:31.774588 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a8dc309b-0c9d-4e40-b0f6-313b0692e3c4 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:31.775106 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a8dc309b-0c9d-4e40-b0f6-313b0692e3c4 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:31.831391 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-14d4c9b8-1647-4caf-b344-ddfde52a676f tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:31.839536 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-14d4c9b8-1647-4caf-b344-ddfde52a676f tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a" status: 200 len: 1362 microversion: 2.1 time: 0.151913 Jul 21 20:05:31.840125 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 56/125] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:31 2022] GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:31.880902 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-ba3777ad-1b11-446e-bd77-d7d1dc37cd62 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:31.881603 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-ba3777ad-1b11-446e-bd77-d7d1dc37cd62 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 514a7771-fbf2-46db-9e3d-905a6a3e703d] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:31.887723 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-ba3777ad-1b11-446e-bd77-d7d1dc37cd62 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:31.888173 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-ba3777ad-1b11-446e-bd77-d7d1dc37cd62 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:31.888942 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-ba3777ad-1b11-446e-bd77-d7d1dc37cd62 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:31.889383 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-ba3777ad-1b11-446e-bd77-d7d1dc37cd62 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:31.905933 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-a8dc309b-0c9d-4e40-b0f6-313b0692e3c4 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0100323b16c045b98dec585b9e59f077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc40ec656240410e862fde9531e0fc55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:31.913418 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-a8dc309b-0c9d-4e40-b0f6-313b0692e3c4 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] 10.222.0.58 "GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc" status: 200 len: 1314 microversion: 2.1 time: 0.151420 Jul 21 20:05:31.913994 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 70/126] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:31 2022] GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:05:32.017503 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-ba3777ad-1b11-446e-bd77-d7d1dc37cd62 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:32.024781 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-ba3777ad-1b11-446e-bd77-d7d1dc37cd62 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d" status: 200 len: 1321 microversion: 2.1 time: 0.148383 Jul 21 20:05:32.025352 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 57/127] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:31 2022] GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d => generated 1321 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:05:32.367811 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-a115103b-068d-4fe9-a8ea-ad11dda4e3ac tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:32.368425 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-a115103b-068d-4fe9-a8ea-ad11dda4e3ac tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 8f00566b-862b-4171-9259-b12aaa7ea030] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:32.374595 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a115103b-068d-4fe9-a8ea-ad11dda4e3ac tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:32.375064 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a115103b-068d-4fe9-a8ea-ad11dda4e3ac tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:32.375835 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a115103b-068d-4fe9-a8ea-ad11dda4e3ac tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:32.376269 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a115103b-068d-4fe9-a8ea-ad11dda4e3ac tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:32.433772 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-94358a36-0820-48a0-b09e-73e2a0e6a703 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:32.434410 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-94358a36-0820-48a0-b09e-73e2a0e6a703 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:32.440439 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-94358a36-0820-48a0-b09e-73e2a0e6a703 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:32.441411 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-94358a36-0820-48a0-b09e-73e2a0e6a703 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:32.442369 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-94358a36-0820-48a0-b09e-73e2a0e6a703 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:32.442918 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-94358a36-0820-48a0-b09e-73e2a0e6a703 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:32.511978 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-a115103b-068d-4fe9-a8ea-ad11dda4e3ac tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:32.520591 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-a115103b-068d-4fe9-a8ea-ad11dda4e3ac tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030" status: 200 len: 1366 microversion: 2.1 time: 0.156454 Jul 21 20:05:32.521480 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 71/128] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:32 2022] GET /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:32.582571 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-94358a36-0820-48a0-b09e-73e2a0e6a703 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:32.590405 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-94358a36-0820-48a0-b09e-73e2a0e6a703 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:32.592341 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-94358a36-0820-48a0-b09e-73e2a0e6a703 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:32.593442 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-94358a36-0820-48a0-b09e-73e2a0e6a703 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1406 microversion: 2.20 time: 0.163666 Jul 21 20:05:32.594005 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 58/129] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:05:32 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 20:05:32.858430 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-561b2060-2ee9-49fc-89b7-14a673746871 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:32.858788 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-561b2060-2ee9-49fc-89b7-14a673746871 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:32.865728 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-561b2060-2ee9-49fc-89b7-14a673746871 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:32.866189 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-561b2060-2ee9-49fc-89b7-14a673746871 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:32.867214 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-561b2060-2ee9-49fc-89b7-14a673746871 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:32.867706 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-561b2060-2ee9-49fc-89b7-14a673746871 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:32.930672 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-55259e16-194c-4934-8629-c1a4a9de561c tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:32.931449 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-55259e16-194c-4934-8629-c1a4a9de561c tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] [instance: 3c7c536b-2058-4226-938c-65ec0ad3dddc] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:32.937867 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-55259e16-194c-4934-8629-c1a4a9de561c tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:32.938300 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-55259e16-194c-4934-8629-c1a4a9de561c tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:32.939102 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-55259e16-194c-4934-8629-c1a4a9de561c tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:32.939543 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-55259e16-194c-4934-8629-c1a4a9de561c tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:33.019191 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-561b2060-2ee9-49fc-89b7-14a673746871 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:33.023292 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell1:SELECT=100 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:05:33.028299 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-561b2060-2ee9-49fc-89b7-14a673746871 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a" status: 200 len: 1362 microversion: 2.1 time: 0.175249 Jul 21 20:05:33.029088 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 72/130] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:32 2022] GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a => generated 1362 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:33.041451 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-4a3b7e33-7f3c-48aa-891f-a16247c4ea77 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:33.042083 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-4a3b7e33-7f3c-48aa-891f-a16247c4ea77 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 514a7771-fbf2-46db-9e3d-905a6a3e703d] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:33.051903 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4a3b7e33-7f3c-48aa-891f-a16247c4ea77 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:33.052624 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4a3b7e33-7f3c-48aa-891f-a16247c4ea77 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:33.053585 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4a3b7e33-7f3c-48aa-891f-a16247c4ea77 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:33.054026 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4a3b7e33-7f3c-48aa-891f-a16247c4ea77 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:33.194268 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-55259e16-194c-4934-8629-c1a4a9de561c tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0100323b16c045b98dec585b9e59f077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc40ec656240410e862fde9531e0fc55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:33.201676 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-55259e16-194c-4934-8629-c1a4a9de561c tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] 10.222.0.58 "GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc" status: 200 len: 1314 microversion: 2.1 time: 0.275263 Jul 21 20:05:33.202277 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 59/131] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:32 2022] GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc => generated 1314 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:05:33.208075 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-4a3b7e33-7f3c-48aa-891f-a16247c4ea77 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:33.215439 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-4a3b7e33-7f3c-48aa-891f-a16247c4ea77 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d" status: 200 len: 1321 microversion: 2.1 time: 0.177794 Jul 21 20:05:33.216254 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 73/132] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:33 2022] GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d => generated 1321 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:05:33.538353 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-0234e627-2a8c-48bb-af33-085820ed7b63 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:33.538942 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-0234e627-2a8c-48bb-af33-085820ed7b63 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 8f00566b-862b-4171-9259-b12aaa7ea030] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:33.545320 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-0234e627-2a8c-48bb-af33-085820ed7b63 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:33.547068 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-0234e627-2a8c-48bb-af33-085820ed7b63 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:33.547865 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-0234e627-2a8c-48bb-af33-085820ed7b63 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:33.548348 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-0234e627-2a8c-48bb-af33-085820ed7b63 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:33.611296 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-ce31e11f-e4a8-4374-be0e-885d5bab7e90 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:33.611904 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-ce31e11f-e4a8-4374-be0e-885d5bab7e90 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:33.620083 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ce31e11f-e4a8-4374-be0e-885d5bab7e90 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:33.620821 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ce31e11f-e4a8-4374-be0e-885d5bab7e90 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:33.622261 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ce31e11f-e4a8-4374-be0e-885d5bab7e90 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:33.622882 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ce31e11f-e4a8-4374-be0e-885d5bab7e90 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:33.901265 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-0234e627-2a8c-48bb-af33-085820ed7b63 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:33.909499 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-0234e627-2a8c-48bb-af33-085820ed7b63 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030" status: 200 len: 1366 microversion: 2.1 time: 0.375663 Jul 21 20:05:33.915340 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 60/133] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:33 2022] GET /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030 => generated 1366 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:05:34.046384 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-56e97557-7a27-4300-b574-313b27e59e2d tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:34.047279 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-56e97557-7a27-4300-b574-313b27e59e2d tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:34.054253 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-56e97557-7a27-4300-b574-313b27e59e2d tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:34.054819 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-56e97557-7a27-4300-b574-313b27e59e2d tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:34.055750 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-56e97557-7a27-4300-b574-313b27e59e2d tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:34.056529 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-56e97557-7a27-4300-b574-313b27e59e2d tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:34.201545 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-ce31e11f-e4a8-4374-be0e-885d5bab7e90 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:34.214496 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-ce31e11f-e4a8-4374-be0e-885d5bab7e90 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:34.216802 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-ce31e11f-e4a8-4374-be0e-885d5bab7e90 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:34.219134 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-ce31e11f-e4a8-4374-be0e-885d5bab7e90 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1406 microversion: 2.20 time: 0.610805 Jul 21 20:05:34.231534 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 74/134] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:05:33 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1406 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 20:05:34.231534 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-ef9635fd-db41-4ed0-84eb-b24cc06f36b9 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:34.231534 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-ef9635fd-db41-4ed0-84eb-b24cc06f36b9 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] [instance: 3c7c536b-2058-4226-938c-65ec0ad3dddc] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:34.233816 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_api:SELECT=100 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:05:34.235965 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ef9635fd-db41-4ed0-84eb-b24cc06f36b9 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:34.236544 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ef9635fd-db41-4ed0-84eb-b24cc06f36b9 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:34.237428 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ef9635fd-db41-4ed0-84eb-b24cc06f36b9 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:34.238196 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ef9635fd-db41-4ed0-84eb-b24cc06f36b9 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:34.296295 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-56e97557-7a27-4300-b574-313b27e59e2d tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:34.304710 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-56e97557-7a27-4300-b574-313b27e59e2d tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a" status: 200 len: 1362 microversion: 2.1 time: 0.262710 Jul 21 20:05:34.307235 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 61/135] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:34 2022] GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a => generated 1362 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:05:34.310484 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-ea1adf89-2549-497f-a278-0d1e6d2168cb tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:34.311271 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-ea1adf89-2549-497f-a278-0d1e6d2168cb tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 514a7771-fbf2-46db-9e3d-905a6a3e703d] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:34.319301 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-ea1adf89-2549-497f-a278-0d1e6d2168cb tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:34.319741 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-ea1adf89-2549-497f-a278-0d1e6d2168cb tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:34.320504 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-ea1adf89-2549-497f-a278-0d1e6d2168cb tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:34.320931 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-ea1adf89-2549-497f-a278-0d1e6d2168cb tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:34.400824 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-ef9635fd-db41-4ed0-84eb-b24cc06f36b9 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0100323b16c045b98dec585b9e59f077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc40ec656240410e862fde9531e0fc55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:34.408562 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-ef9635fd-db41-4ed0-84eb-b24cc06f36b9 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] 10.222.0.58 "GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc" status: 200 len: 1314 microversion: 2.1 time: 0.187215 Jul 21 20:05:34.418000 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 75/136] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:34 2022] GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:34.458411 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-ea1adf89-2549-497f-a278-0d1e6d2168cb tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:34.473892 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-ea1adf89-2549-497f-a278-0d1e6d2168cb tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d" status: 200 len: 1321 microversion: 2.1 time: 0.160031 Jul 21 20:05:34.473892 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 62/137] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:34 2022] GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:34.927395 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-c650b924-8776-4b06-93b0-e23d15c0f14e tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:34.928009 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-c650b924-8776-4b06-93b0-e23d15c0f14e tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 8f00566b-862b-4171-9259-b12aaa7ea030] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:34.934435 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c650b924-8776-4b06-93b0-e23d15c0f14e tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:34.934878 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c650b924-8776-4b06-93b0-e23d15c0f14e tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:34.935681 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c650b924-8776-4b06-93b0-e23d15c0f14e tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:34.936106 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c650b924-8776-4b06-93b0-e23d15c0f14e tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:35.061895 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-c650b924-8776-4b06-93b0-e23d15c0f14e tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:35.070012 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-c650b924-8776-4b06-93b0-e23d15c0f14e tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030" status: 200 len: 1366 microversion: 2.1 time: 0.147012 Jul 21 20:05:35.070580 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 76/138] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:34 2022] GET /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030 => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:35.238038 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-7714b53d-f0d4-43ee-a002-abb0247aa80f tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:35.238634 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-7714b53d-f0d4-43ee-a002-abb0247aa80f tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:35.244755 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-7714b53d-f0d4-43ee-a002-abb0247aa80f tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:35.245254 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-7714b53d-f0d4-43ee-a002-abb0247aa80f tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:35.246008 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-7714b53d-f0d4-43ee-a002-abb0247aa80f tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:35.247094 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-7714b53d-f0d4-43ee-a002-abb0247aa80f tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:35.322468 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-cdc0db85-496e-45ec-a29e-9e8cc3bffcd5 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:35.323104 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-cdc0db85-496e-45ec-a29e-9e8cc3bffcd5 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:35.329520 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-cdc0db85-496e-45ec-a29e-9e8cc3bffcd5 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:35.329954 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-cdc0db85-496e-45ec-a29e-9e8cc3bffcd5 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:35.331079 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-cdc0db85-496e-45ec-a29e-9e8cc3bffcd5 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:35.331200 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-cdc0db85-496e-45ec-a29e-9e8cc3bffcd5 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:35.473447 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-cdc0db85-496e-45ec-a29e-9e8cc3bffcd5 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:35.482702 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-cdc0db85-496e-45ec-a29e-9e8cc3bffcd5 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a" status: 200 len: 1362 microversion: 2.1 time: 0.164202 Jul 21 20:05:35.483876 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 77/139] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:35 2022] GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:05:35.489168 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-48a49220-f3a3-450d-ae53-35db82627143 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:35.489928 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-48a49220-f3a3-450d-ae53-35db82627143 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] [instance: 3c7c536b-2058-4226-938c-65ec0ad3dddc] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:35.497320 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-48a49220-f3a3-450d-ae53-35db82627143 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:35.497927 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-48a49220-f3a3-450d-ae53-35db82627143 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:35.498842 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-48a49220-f3a3-450d-ae53-35db82627143 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:35.499469 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-48a49220-f3a3-450d-ae53-35db82627143 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:35.544934 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-7714b53d-f0d4-43ee-a002-abb0247aa80f tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:35.553442 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-7714b53d-f0d4-43ee-a002-abb0247aa80f tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:35.555079 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-7714b53d-f0d4-43ee-a002-abb0247aa80f tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:35.556394 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-7714b53d-f0d4-43ee-a002-abb0247aa80f tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1406 microversion: 2.20 time: 0.322372 Jul 21 20:05:35.557050 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 63/140] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:05:35 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1406 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:05:35.570677 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-28902037-4c58-47a5-8285-fe2f8c6d5a96 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:35.571328 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-28902037-4c58-47a5-8285-fe2f8c6d5a96 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 514a7771-fbf2-46db-9e3d-905a6a3e703d] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:35.577445 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-28902037-4c58-47a5-8285-fe2f8c6d5a96 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:35.578036 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-28902037-4c58-47a5-8285-fe2f8c6d5a96 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:35.579072 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-28902037-4c58-47a5-8285-fe2f8c6d5a96 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:35.579638 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-28902037-4c58-47a5-8285-fe2f8c6d5a96 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:35.658683 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-48a49220-f3a3-450d-ae53-35db82627143 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0100323b16c045b98dec585b9e59f077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc40ec656240410e862fde9531e0fc55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:35.667424 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-48a49220-f3a3-450d-ae53-35db82627143 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] 10.222.0.58 "GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc" status: 200 len: 1314 microversion: 2.1 time: 0.182313 Jul 21 20:05:35.668210 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 78/141] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:35 2022] GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:35.714500 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-28902037-4c58-47a5-8285-fe2f8c6d5a96 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:35.722327 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-28902037-4c58-47a5-8285-fe2f8c6d5a96 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d" status: 200 len: 1321 microversion: 2.1 time: 0.157830 Jul 21 20:05:35.722897 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 64/142] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:35 2022] GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:36.087216 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-206b411c-b4be-4776-9981-0e435d7a330d tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:36.087831 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-206b411c-b4be-4776-9981-0e435d7a330d tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 8f00566b-862b-4171-9259-b12aaa7ea030] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:36.094147 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-206b411c-b4be-4776-9981-0e435d7a330d tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:36.094594 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-206b411c-b4be-4776-9981-0e435d7a330d tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:36.095392 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-206b411c-b4be-4776-9981-0e435d7a330d tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:36.095827 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-206b411c-b4be-4776-9981-0e435d7a330d tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:36.234001 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-206b411c-b4be-4776-9981-0e435d7a330d tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:36.242295 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-206b411c-b4be-4776-9981-0e435d7a330d tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030" status: 200 len: 1366 microversion: 2.1 time: 0.159033 Jul 21 20:05:36.242935 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 79/143] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:36 2022] GET /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:36.500302 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-5b4e54f6-d498-4258-8202-eaca2a8e8a2b tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:36.501064 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-5b4e54f6-d498-4258-8202-eaca2a8e8a2b tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:36.507156 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-5b4e54f6-d498-4258-8202-eaca2a8e8a2b tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:36.507607 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-5b4e54f6-d498-4258-8202-eaca2a8e8a2b tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:36.508363 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-5b4e54f6-d498-4258-8202-eaca2a8e8a2b tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:36.508798 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-5b4e54f6-d498-4258-8202-eaca2a8e8a2b tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:36.575169 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-0f091796-7e69-4d0a-b1ff-68f06b771319 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:36.576068 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-0f091796-7e69-4d0a-b1ff-68f06b771319 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:36.582495 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0f091796-7e69-4d0a-b1ff-68f06b771319 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:36.582925 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0f091796-7e69-4d0a-b1ff-68f06b771319 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:36.583737 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0f091796-7e69-4d0a-b1ff-68f06b771319 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:36.584161 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0f091796-7e69-4d0a-b1ff-68f06b771319 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:36.643629 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-5b4e54f6-d498-4258-8202-eaca2a8e8a2b tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:36.651362 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-5b4e54f6-d498-4258-8202-eaca2a8e8a2b tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a" status: 200 len: 1362 microversion: 2.1 time: 0.154997 Jul 21 20:05:36.651948 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 65/144] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:36 2022] GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:36.685378 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-b113ac61-f4a1-4ee5-8014-50b99a128d1d tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:36.696744 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-b113ac61-f4a1-4ee5-8014-50b99a128d1d tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] [instance: 3c7c536b-2058-4226-938c-65ec0ad3dddc] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:36.696744 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-b113ac61-f4a1-4ee5-8014-50b99a128d1d tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:36.696744 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-b113ac61-f4a1-4ee5-8014-50b99a128d1d tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:36.696744 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-b113ac61-f4a1-4ee5-8014-50b99a128d1d tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:36.697119 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-b113ac61-f4a1-4ee5-8014-50b99a128d1d tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:36.717287 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-0f091796-7e69-4d0a-b1ff-68f06b771319 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:36.727066 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-0f091796-7e69-4d0a-b1ff-68f06b771319 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:36.730628 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-0f091796-7e69-4d0a-b1ff-68f06b771319 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:36.731858 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-0f091796-7e69-4d0a-b1ff-68f06b771319 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1406 microversion: 2.20 time: 0.160871 Jul 21 20:05:36.732416 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 80/145] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:05:36 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 20:05:36.740458 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-dd04355e-b80f-40b2-84d4-a6b29cde406a tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:36.741340 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-dd04355e-b80f-40b2-84d4-a6b29cde406a tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 514a7771-fbf2-46db-9e3d-905a6a3e703d] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:36.759835 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-dd04355e-b80f-40b2-84d4-a6b29cde406a tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:36.759835 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-dd04355e-b80f-40b2-84d4-a6b29cde406a tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:36.759835 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-dd04355e-b80f-40b2-84d4-a6b29cde406a tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:36.759835 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-dd04355e-b80f-40b2-84d4-a6b29cde406a tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:36.839897 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-b113ac61-f4a1-4ee5-8014-50b99a128d1d tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0100323b16c045b98dec585b9e59f077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc40ec656240410e862fde9531e0fc55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:36.857941 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-b113ac61-f4a1-4ee5-8014-50b99a128d1d tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] 10.222.0.58 "GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc" status: 200 len: 1314 microversion: 2.1 time: 0.167022 Jul 21 20:05:36.857941 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 66/146] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:36 2022] GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:05:36.898762 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-dd04355e-b80f-40b2-84d4-a6b29cde406a tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:36.906763 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-dd04355e-b80f-40b2-84d4-a6b29cde406a tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d" status: 200 len: 1321 microversion: 2.1 time: 0.170659 Jul 21 20:05:36.907598 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 81/147] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:36 2022] GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d => generated 1321 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:37.265533 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-3607c93a-114b-4dcd-a471-1ca2beaf41cd tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:37.265533 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-3607c93a-114b-4dcd-a471-1ca2beaf41cd tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 8f00566b-862b-4171-9259-b12aaa7ea030] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:37.267807 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-3607c93a-114b-4dcd-a471-1ca2beaf41cd tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:37.268498 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-3607c93a-114b-4dcd-a471-1ca2beaf41cd tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:37.269951 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-3607c93a-114b-4dcd-a471-1ca2beaf41cd tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:37.270719 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-3607c93a-114b-4dcd-a471-1ca2beaf41cd tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:37.669585 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-d465097a-e01d-43fc-bf87-00a69f0c0484 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:37.672026 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-d465097a-e01d-43fc-bf87-00a69f0c0484 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:37.689642 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d465097a-e01d-43fc-bf87-00a69f0c0484 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:37.693245 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d465097a-e01d-43fc-bf87-00a69f0c0484 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:37.694329 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d465097a-e01d-43fc-bf87-00a69f0c0484 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:37.698504 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d465097a-e01d-43fc-bf87-00a69f0c0484 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:38.018329 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-3607c93a-114b-4dcd-a471-1ca2beaf41cd tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:38.028012 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-3607c93a-114b-4dcd-a471-1ca2beaf41cd tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030" status: 200 len: 1366 microversion: 2.1 time: 0.771560 Jul 21 20:05:38.029016 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 67/148] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:37 2022] GET /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030 => generated 1366 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:38.044189 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-e53d8d57-3d12-4038-a31a-8d8eeb989e02 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:38.044984 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-e53d8d57-3d12-4038-a31a-8d8eeb989e02 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:38.051477 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-e53d8d57-3d12-4038-a31a-8d8eeb989e02 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:38.051913 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-e53d8d57-3d12-4038-a31a-8d8eeb989e02 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:38.052675 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-e53d8d57-3d12-4038-a31a-8d8eeb989e02 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:38.053100 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-e53d8d57-3d12-4038-a31a-8d8eeb989e02 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:38.133368 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-d465097a-e01d-43fc-bf87-00a69f0c0484 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:38.140862 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-d465097a-e01d-43fc-bf87-00a69f0c0484 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a" status: 200 len: 1362 microversion: 2.1 time: 0.476006 Jul 21 20:05:38.145095 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 82/149] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:37 2022] GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a => generated 1362 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:05:38.150108 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-4ef95e6c-44b0-4fe1-82d1-6dfdf36d4fe7 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:38.153092 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-4ef95e6c-44b0-4fe1-82d1-6dfdf36d4fe7 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] [instance: 3c7c536b-2058-4226-938c-65ec0ad3dddc] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:38.158198 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4ef95e6c-44b0-4fe1-82d1-6dfdf36d4fe7 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:38.158878 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4ef95e6c-44b0-4fe1-82d1-6dfdf36d4fe7 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:38.160482 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4ef95e6c-44b0-4fe1-82d1-6dfdf36d4fe7 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:38.161140 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4ef95e6c-44b0-4fe1-82d1-6dfdf36d4fe7 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:38.346899 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-e53d8d57-3d12-4038-a31a-8d8eeb989e02 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:38.360820 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-e53d8d57-3d12-4038-a31a-8d8eeb989e02 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:38.362405 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-e53d8d57-3d12-4038-a31a-8d8eeb989e02 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:38.363573 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-e53d8d57-3d12-4038-a31a-8d8eeb989e02 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1406 microversion: 2.20 time: 0.323367 Jul 21 20:05:38.365076 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 68/150] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:05:38 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1406 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:05:38.369012 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-65dc1fca-566f-490a-8e5b-bb41b8687f33 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:38.369625 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-65dc1fca-566f-490a-8e5b-bb41b8687f33 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 514a7771-fbf2-46db-9e3d-905a6a3e703d] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:38.375814 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-65dc1fca-566f-490a-8e5b-bb41b8687f33 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:38.376258 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-65dc1fca-566f-490a-8e5b-bb41b8687f33 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:38.377323 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-65dc1fca-566f-490a-8e5b-bb41b8687f33 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:38.377760 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-65dc1fca-566f-490a-8e5b-bb41b8687f33 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:38.402541 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-4ef95e6c-44b0-4fe1-82d1-6dfdf36d4fe7 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0100323b16c045b98dec585b9e59f077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc40ec656240410e862fde9531e0fc55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:38.410072 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-4ef95e6c-44b0-4fe1-82d1-6dfdf36d4fe7 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] 10.222.0.58 "GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc" status: 200 len: 1314 microversion: 2.1 time: 0.263547 Jul 21 20:05:38.410639 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 83/151] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:38 2022] GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc => generated 1314 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:38.511243 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-65dc1fca-566f-490a-8e5b-bb41b8687f33 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:38.518817 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-65dc1fca-566f-490a-8e5b-bb41b8687f33 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d" status: 200 len: 1321 microversion: 2.1 time: 0.153711 Jul 21 20:05:38.520103 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 69/152] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:38 2022] GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:39.045718 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-7480b9a5-ec72-4fa5-a3b1-33cdc23e5288 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:39.046256 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-7480b9a5-ec72-4fa5-a3b1-33cdc23e5288 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 8f00566b-862b-4171-9259-b12aaa7ea030] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:39.052565 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-7480b9a5-ec72-4fa5-a3b1-33cdc23e5288 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:39.053084 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-7480b9a5-ec72-4fa5-a3b1-33cdc23e5288 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:39.053869 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-7480b9a5-ec72-4fa5-a3b1-33cdc23e5288 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:39.054285 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-7480b9a5-ec72-4fa5-a3b1-33cdc23e5288 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:39.160561 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-6c1ef294-2cc5-47c3-b85c-7413441a3bac tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:39.162543 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-6c1ef294-2cc5-47c3-b85c-7413441a3bac tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:39.170230 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-6c1ef294-2cc5-47c3-b85c-7413441a3bac tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:39.170929 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-6c1ef294-2cc5-47c3-b85c-7413441a3bac tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:39.171982 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-6c1ef294-2cc5-47c3-b85c-7413441a3bac tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:39.172487 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-6c1ef294-2cc5-47c3-b85c-7413441a3bac tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:39.219697 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-7480b9a5-ec72-4fa5-a3b1-33cdc23e5288 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:39.229174 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-7480b9a5-ec72-4fa5-a3b1-33cdc23e5288 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030" status: 200 len: 1366 microversion: 2.1 time: 0.187340 Jul 21 20:05:39.229964 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 84/153] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:39 2022] GET /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030 => generated 1366 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:39.324576 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-6c1ef294-2cc5-47c3-b85c-7413441a3bac tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:39.333184 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-6c1ef294-2cc5-47c3-b85c-7413441a3bac tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a" status: 200 len: 1362 microversion: 2.1 time: 0.179035 Jul 21 20:05:39.334320 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 70/154] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:39 2022] GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a => generated 1362 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:39.382501 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-f8d9de32-46ca-457a-94f5-e8d977b137af tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:39.383141 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-f8d9de32-46ca-457a-94f5-e8d977b137af tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:39.389073 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f8d9de32-46ca-457a-94f5-e8d977b137af tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:39.389520 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f8d9de32-46ca-457a-94f5-e8d977b137af tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:39.390315 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f8d9de32-46ca-457a-94f5-e8d977b137af tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:39.390748 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f8d9de32-46ca-457a-94f5-e8d977b137af tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:39.477701 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [req-ac775f30-9610-4beb-aa4b-906b1e9a3909 req-5334567a-f613-4866-a53c-02412a776c5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c7c536b-2058-4226-938c-65ec0ad3dddc", "name": "network-vif-plugged", "status": "completed", "tag": "d0b6dfdf-6c03-4e2a-a6e3-7065bda3a505"}]} {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:05:39.486121 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [req-ac775f30-9610-4beb-aa4b-906b1e9a3909 req-5334567a-f613-4866-a53c-02412a776c5d service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:39.486565 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [req-ac775f30-9610-4beb-aa4b-906b1e9a3909 req-5334567a-f613-4866-a53c-02412a776c5d service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:39.498468 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.compute.server_external_events [req-ac775f30-9610-4beb-aa4b-906b1e9a3909 req-5334567a-f613-4866-a53c-02412a776c5d service nova] Creating event network-vif-plugged:d0b6dfdf-6c03-4e2a-a6e3-7065bda3a505 for instance 3c7c536b-2058-4226-938c-65ec0ad3dddc on hv-cinder-85054 Jul 21 20:05:39.504420 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [req-ac775f30-9610-4beb-aa4b-906b1e9a3909 req-5334567a-f613-4866-a53c-02412a776c5d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096106 Jul 21 20:05:39.505093 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 71/155] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 20:05:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:05:39.511112 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-c0d2f49f-a7fe-4194-9606-b2ae25cd04b6 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:39.511818 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-c0d2f49f-a7fe-4194-9606-b2ae25cd04b6 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] [instance: 3c7c536b-2058-4226-938c-65ec0ad3dddc] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:39.519198 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-c0d2f49f-a7fe-4194-9606-b2ae25cd04b6 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:39.519503 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-c0d2f49f-a7fe-4194-9606-b2ae25cd04b6 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:39.520279 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-c0d2f49f-a7fe-4194-9606-b2ae25cd04b6 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:39.520709 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-c0d2f49f-a7fe-4194-9606-b2ae25cd04b6 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:39.524987 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG dbcounter [-] [118344] Writing DB stats nova_cell1:SELECT=100 {{(pid=118344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:05:39.528755 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-f8d9de32-46ca-457a-94f5-e8d977b137af tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:39.537235 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-f8d9de32-46ca-457a-94f5-e8d977b137af tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:39.540599 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-f8d9de32-46ca-457a-94f5-e8d977b137af tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:39.543047 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-f8d9de32-46ca-457a-94f5-e8d977b137af tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1406 microversion: 2.20 time: 0.163866 Jul 21 20:05:39.543047 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 85/156] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:05:39 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 20:05:39.546700 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-64d0f33a-b483-419c-8d83-93b2662a1188 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:39.548433 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-64d0f33a-b483-419c-8d83-93b2662a1188 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 514a7771-fbf2-46db-9e3d-905a6a3e703d] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:39.555524 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-64d0f33a-b483-419c-8d83-93b2662a1188 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:39.556183 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-64d0f33a-b483-419c-8d83-93b2662a1188 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:39.557116 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-64d0f33a-b483-419c-8d83-93b2662a1188 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:39.557701 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-64d0f33a-b483-419c-8d83-93b2662a1188 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:39.698633 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-64d0f33a-b483-419c-8d83-93b2662a1188 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:39.708537 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-64d0f33a-b483-419c-8d83-93b2662a1188 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d" status: 200 len: 1321 microversion: 2.1 time: 0.165100 Jul 21 20:05:39.709774 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 86/157] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:39 2022] GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d => generated 1321 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:39.835733 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-c0d2f49f-a7fe-4194-9606-b2ae25cd04b6 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0100323b16c045b98dec585b9e59f077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc40ec656240410e862fde9531e0fc55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:39.844258 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-c0d2f49f-a7fe-4194-9606-b2ae25cd04b6 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] 10.222.0.58 "GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc" status: 200 len: 1314 microversion: 2.1 time: 0.337856 Jul 21 20:05:39.844843 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 72/158] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:39 2022] GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc => generated 1314 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:40.247908 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-172ddb05-1b0e-4126-8c85-c78027d3c368 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:40.248521 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-172ddb05-1b0e-4126-8c85-c78027d3c368 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 8f00566b-862b-4171-9259-b12aaa7ea030] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:40.255284 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-172ddb05-1b0e-4126-8c85-c78027d3c368 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:40.255733 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-172ddb05-1b0e-4126-8c85-c78027d3c368 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:40.256641 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-172ddb05-1b0e-4126-8c85-c78027d3c368 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:40.257072 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-172ddb05-1b0e-4126-8c85-c78027d3c368 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:40.352645 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-a0a24f6e-f209-422a-9c44-1bb05419e7ce tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:40.352645 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-a0a24f6e-f209-422a-9c44-1bb05419e7ce tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:40.359411 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-a0a24f6e-f209-422a-9c44-1bb05419e7ce tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:40.360119 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-a0a24f6e-f209-422a-9c44-1bb05419e7ce tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:40.361095 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-a0a24f6e-f209-422a-9c44-1bb05419e7ce tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:40.361750 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-a0a24f6e-f209-422a-9c44-1bb05419e7ce tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:40.421695 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-172ddb05-1b0e-4126-8c85-c78027d3c368 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:40.429914 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-172ddb05-1b0e-4126-8c85-c78027d3c368 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030" status: 200 len: 1366 microversion: 2.1 time: 0.188035 Jul 21 20:05:40.430702 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 87/159] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:40 2022] GET /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030 => generated 1366 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:40.560338 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-76394c9c-8af9-431f-9634-769316ce3136 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:40.561180 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-76394c9c-8af9-431f-9634-769316ce3136 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:40.568609 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-76394c9c-8af9-431f-9634-769316ce3136 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:40.576339 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-a0a24f6e-f209-422a-9c44-1bb05419e7ce tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:40.580688 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-76394c9c-8af9-431f-9634-769316ce3136 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:40.582005 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-76394c9c-8af9-431f-9634-769316ce3136 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:40.582618 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-76394c9c-8af9-431f-9634-769316ce3136 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:40.591835 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-a0a24f6e-f209-422a-9c44-1bb05419e7ce tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a" status: 200 len: 1362 microversion: 2.1 time: 0.244567 Jul 21 20:05:40.592421 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 73/160] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:40 2022] GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a => generated 1362 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:05:40.726562 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-543985fb-7bc1-46bd-9e79-4d672223dcef tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:40.727699 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-543985fb-7bc1-46bd-9e79-4d672223dcef tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 514a7771-fbf2-46db-9e3d-905a6a3e703d] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:40.734676 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-543985fb-7bc1-46bd-9e79-4d672223dcef tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:40.735265 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-543985fb-7bc1-46bd-9e79-4d672223dcef tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:40.736112 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-543985fb-7bc1-46bd-9e79-4d672223dcef tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:40.736613 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-543985fb-7bc1-46bd-9e79-4d672223dcef tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:40.882813 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-543985fb-7bc1-46bd-9e79-4d672223dcef tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:40.890970 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-543985fb-7bc1-46bd-9e79-4d672223dcef tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d" status: 200 len: 1321 microversion: 2.1 time: 0.168748 Jul 21 20:05:40.892888 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 74/161] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:40 2022] GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d => generated 1321 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:05:40.899848 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-4f4e40fb-37f0-4467-9fb5-c0e2332d20c4 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:40.900682 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-4f4e40fb-37f0-4467-9fb5-c0e2332d20c4 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] [instance: 3c7c536b-2058-4226-938c-65ec0ad3dddc] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:40.910251 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-4f4e40fb-37f0-4467-9fb5-c0e2332d20c4 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:40.910912 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-4f4e40fb-37f0-4467-9fb5-c0e2332d20c4 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:40.911908 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-4f4e40fb-37f0-4467-9fb5-c0e2332d20c4 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:40.912529 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-4f4e40fb-37f0-4467-9fb5-c0e2332d20c4 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:41.048219 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-76394c9c-8af9-431f-9634-769316ce3136 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:41.065179 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-76394c9c-8af9-431f-9634-769316ce3136 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:41.067328 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-76394c9c-8af9-431f-9634-769316ce3136 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:41.068670 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-76394c9c-8af9-431f-9634-769316ce3136 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1406 microversion: 2.20 time: 0.512303 Jul 21 20:05:41.079526 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 88/162] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:05:40 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1406 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 20:05:41.111566 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-4f4e40fb-37f0-4467-9fb5-c0e2332d20c4 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0100323b16c045b98dec585b9e59f077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc40ec656240410e862fde9531e0fc55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:41.120344 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-4f4e40fb-37f0-4467-9fb5-c0e2332d20c4 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] 10.222.0.58 "GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc" status: 200 len: 1314 microversion: 2.1 time: 0.226292 Jul 21 20:05:41.121107 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 75/163] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:40 2022] GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:41.447177 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-25c34efe-ed70-4285-9578-32dc7fee15cc tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:41.455556 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-25c34efe-ed70-4285-9578-32dc7fee15cc tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 8f00566b-862b-4171-9259-b12aaa7ea030] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:41.461642 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-25c34efe-ed70-4285-9578-32dc7fee15cc tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:41.462099 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-25c34efe-ed70-4285-9578-32dc7fee15cc tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:41.462869 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-25c34efe-ed70-4285-9578-32dc7fee15cc tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:41.463330 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-25c34efe-ed70-4285-9578-32dc7fee15cc tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:41.482250 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell1:SELECT=100 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:05:41.596419 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-25c34efe-ed70-4285-9578-32dc7fee15cc tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:41.615317 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-522b2186-3c82-4bd8-9ebb-b7033d17734d tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:41.615317 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-522b2186-3c82-4bd8-9ebb-b7033d17734d tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:41.617562 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-25c34efe-ed70-4285-9578-32dc7fee15cc tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030" status: 200 len: 1366 microversion: 2.1 time: 0.174168 Jul 21 20:05:41.620998 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 89/164] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:41 2022] GET /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030 => generated 1366 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:41.630361 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-522b2186-3c82-4bd8-9ebb-b7033d17734d tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:41.631104 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-522b2186-3c82-4bd8-9ebb-b7033d17734d tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:41.632053 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-522b2186-3c82-4bd8-9ebb-b7033d17734d tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:41.632945 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-522b2186-3c82-4bd8-9ebb-b7033d17734d tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:41.841813 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-522b2186-3c82-4bd8-9ebb-b7033d17734d tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:41.849409 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-522b2186-3c82-4bd8-9ebb-b7033d17734d tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a" status: 200 len: 1362 microversion: 2.1 time: 0.243990 Jul 21 20:05:41.850618 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 76/165] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:41 2022] GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a => generated 1362 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:41.909436 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-0f109532-5f71-4978-93f7-17eed37b1f18 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:41.910082 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-0f109532-5f71-4978-93f7-17eed37b1f18 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 514a7771-fbf2-46db-9e3d-905a6a3e703d] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:41.916281 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0f109532-5f71-4978-93f7-17eed37b1f18 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:41.916730 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0f109532-5f71-4978-93f7-17eed37b1f18 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:41.917488 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0f109532-5f71-4978-93f7-17eed37b1f18 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:41.917922 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0f109532-5f71-4978-93f7-17eed37b1f18 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:42.075352 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-0f109532-5f71-4978-93f7-17eed37b1f18 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:42.085528 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-0f109532-5f71-4978-93f7-17eed37b1f18 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d" status: 200 len: 1321 microversion: 2.1 time: 0.179505 Jul 21 20:05:42.085712 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-db267e40-5f07-475c-bf7d-2c2bd14b7b0f tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:42.096283 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-db267e40-5f07-475c-bf7d-2c2bd14b7b0f tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:42.096283 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-db267e40-5f07-475c-bf7d-2c2bd14b7b0f tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:42.096283 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-db267e40-5f07-475c-bf7d-2c2bd14b7b0f tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:42.096283 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-db267e40-5f07-475c-bf7d-2c2bd14b7b0f tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:42.104077 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-db267e40-5f07-475c-bf7d-2c2bd14b7b0f tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:42.104320 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 90/166] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:41 2022] GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d => generated 1321 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:42.137666 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-674515c2-da22-46e8-8e3f-9d3aec642c5f tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:42.138272 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-674515c2-da22-46e8-8e3f-9d3aec642c5f tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] [instance: 3c7c536b-2058-4226-938c-65ec0ad3dddc] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:42.144474 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-674515c2-da22-46e8-8e3f-9d3aec642c5f tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:42.144918 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-674515c2-da22-46e8-8e3f-9d3aec642c5f tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:42.145690 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-674515c2-da22-46e8-8e3f-9d3aec642c5f tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:42.146120 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-674515c2-da22-46e8-8e3f-9d3aec642c5f tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:42.238668 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-db267e40-5f07-475c-bf7d-2c2bd14b7b0f tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:42.246912 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-db267e40-5f07-475c-bf7d-2c2bd14b7b0f tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:42.248464 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-db267e40-5f07-475c-bf7d-2c2bd14b7b0f tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:42.249627 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-db267e40-5f07-475c-bf7d-2c2bd14b7b0f tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1406 microversion: 2.20 time: 0.167835 Jul 21 20:05:42.250237 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 77/167] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:05:42 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 20:05:42.282413 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-674515c2-da22-46e8-8e3f-9d3aec642c5f tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0100323b16c045b98dec585b9e59f077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc40ec656240410e862fde9531e0fc55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:42.289923 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-674515c2-da22-46e8-8e3f-9d3aec642c5f tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] 10.222.0.58 "GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc" status: 200 len: 1314 microversion: 2.1 time: 0.156151 Jul 21 20:05:42.290551 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 91/168] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:42 2022] GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:05:42.636966 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-885f5675-7750-4ae5-be4b-5b3fab1e79cf tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:42.637577 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-885f5675-7750-4ae5-be4b-5b3fab1e79cf tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 8f00566b-862b-4171-9259-b12aaa7ea030] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:42.640491 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG dbcounter [-] [118344] Writing DB stats nova_api:SELECT=100 {{(pid=118344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:05:42.644312 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-885f5675-7750-4ae5-be4b-5b3fab1e79cf tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:42.644765 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-885f5675-7750-4ae5-be4b-5b3fab1e79cf tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:42.645529 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-885f5675-7750-4ae5-be4b-5b3fab1e79cf tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:42.645964 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-885f5675-7750-4ae5-be4b-5b3fab1e79cf tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:42.821352 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-885f5675-7750-4ae5-be4b-5b3fab1e79cf tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:42.829206 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-885f5675-7750-4ae5-be4b-5b3fab1e79cf tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030" status: 200 len: 1366 microversion: 2.1 time: 0.196044 Jul 21 20:05:42.829851 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 78/169] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:42 2022] GET /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030 => generated 1366 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:42.866776 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-f0030d2b-fe46-4f8a-9ddb-17594bc7b911 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:42.867432 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-f0030d2b-fe46-4f8a-9ddb-17594bc7b911 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:42.873628 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f0030d2b-fe46-4f8a-9ddb-17594bc7b911 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:42.874068 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f0030d2b-fe46-4f8a-9ddb-17594bc7b911 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:42.874933 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f0030d2b-fe46-4f8a-9ddb-17594bc7b911 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:42.875403 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f0030d2b-fe46-4f8a-9ddb-17594bc7b911 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:43.020082 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-f0030d2b-fe46-4f8a-9ddb-17594bc7b911 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:43.038105 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-f0030d2b-fe46-4f8a-9ddb-17594bc7b911 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a" status: 200 len: 1362 microversion: 2.1 time: 0.164817 Jul 21 20:05:43.038105 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 92/170] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:42 2022] GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:43.103891 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-480a91f2-84a7-460e-a744-3aeac5893b51 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:43.104499 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-480a91f2-84a7-460e-a744-3aeac5893b51 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 514a7771-fbf2-46db-9e3d-905a6a3e703d] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:43.110724 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-480a91f2-84a7-460e-a744-3aeac5893b51 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:43.111213 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-480a91f2-84a7-460e-a744-3aeac5893b51 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:43.111968 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-480a91f2-84a7-460e-a744-3aeac5893b51 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:43.112400 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-480a91f2-84a7-460e-a744-3aeac5893b51 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:43.251314 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-480a91f2-84a7-460e-a744-3aeac5893b51 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:43.261074 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-480a91f2-84a7-460e-a744-3aeac5893b51 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d" status: 200 len: 1321 microversion: 2.1 time: 0.159981 Jul 21 20:05:43.261074 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 79/171] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:43 2022] GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:43.270869 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-5833fb7b-c455-454e-bc99-34b856bd95ca tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:43.271594 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-5833fb7b-c455-454e-bc99-34b856bd95ca tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:43.279147 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5833fb7b-c455-454e-bc99-34b856bd95ca tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:43.279147 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5833fb7b-c455-454e-bc99-34b856bd95ca tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:43.279667 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5833fb7b-c455-454e-bc99-34b856bd95ca tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:43.280125 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5833fb7b-c455-454e-bc99-34b856bd95ca tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:43.307317 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-4b556446-78be-4a44-abb1-f8c766b393b9 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:43.308437 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-4b556446-78be-4a44-abb1-f8c766b393b9 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] [instance: 3c7c536b-2058-4226-938c-65ec0ad3dddc] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:43.316584 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-4b556446-78be-4a44-abb1-f8c766b393b9 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:43.317113 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-4b556446-78be-4a44-abb1-f8c766b393b9 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:43.318089 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-4b556446-78be-4a44-abb1-f8c766b393b9 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:43.318715 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-4b556446-78be-4a44-abb1-f8c766b393b9 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:43.449225 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-5833fb7b-c455-454e-bc99-34b856bd95ca tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:43.463844 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-5833fb7b-c455-454e-bc99-34b856bd95ca tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:43.465551 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-5833fb7b-c455-454e-bc99-34b856bd95ca tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:43.466919 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-5833fb7b-c455-454e-bc99-34b856bd95ca tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1406 microversion: 2.20 time: 0.200160 Jul 21 20:05:43.467720 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 93/172] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:05:43 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1406 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:05:43.480549 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-4b556446-78be-4a44-abb1-f8c766b393b9 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0100323b16c045b98dec585b9e59f077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc40ec656240410e862fde9531e0fc55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:43.491296 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-4b556446-78be-4a44-abb1-f8c766b393b9 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] 10.222.0.58 "GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc" status: 200 len: 1314 microversion: 2.1 time: 0.187773 Jul 21 20:05:43.492148 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 80/173] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:43 2022] GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:05:43.846677 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-fb98a463-a53b-465e-b1db-e6fec99dcd7f tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:43.847878 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-fb98a463-a53b-465e-b1db-e6fec99dcd7f tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 8f00566b-862b-4171-9259-b12aaa7ea030] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:43.854080 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-fb98a463-a53b-465e-b1db-e6fec99dcd7f tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:43.854528 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-fb98a463-a53b-465e-b1db-e6fec99dcd7f tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:43.855392 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-fb98a463-a53b-465e-b1db-e6fec99dcd7f tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:43.855827 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-fb98a463-a53b-465e-b1db-e6fec99dcd7f tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:43.994853 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-fb98a463-a53b-465e-b1db-e6fec99dcd7f tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:44.004439 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-fb98a463-a53b-465e-b1db-e6fec99dcd7f tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030" status: 200 len: 1366 microversion: 2.1 time: 0.161507 Jul 21 20:05:44.005015 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 94/174] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:43 2022] GET /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:44.045323 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-45f5e4b8-bd55-40ce-8872-ad8c37b37c51 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:44.045931 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-45f5e4b8-bd55-40ce-8872-ad8c37b37c51 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:44.054432 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-45f5e4b8-bd55-40ce-8872-ad8c37b37c51 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:44.054770 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-45f5e4b8-bd55-40ce-8872-ad8c37b37c51 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:44.055576 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-45f5e4b8-bd55-40ce-8872-ad8c37b37c51 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:44.056035 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-45f5e4b8-bd55-40ce-8872-ad8c37b37c51 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:44.205069 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-45f5e4b8-bd55-40ce-8872-ad8c37b37c51 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:44.213174 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-45f5e4b8-bd55-40ce-8872-ad8c37b37c51 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a" status: 200 len: 1362 microversion: 2.1 time: 0.172226 Jul 21 20:05:44.215049 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 81/175] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:44 2022] GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:44.279430 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-bb0e91b4-1c30-4db4-a096-97666ee0dc13 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:44.280041 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-bb0e91b4-1c30-4db4-a096-97666ee0dc13 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 514a7771-fbf2-46db-9e3d-905a6a3e703d] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:44.286467 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-bb0e91b4-1c30-4db4-a096-97666ee0dc13 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:44.286973 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-bb0e91b4-1c30-4db4-a096-97666ee0dc13 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:44.287937 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-bb0e91b4-1c30-4db4-a096-97666ee0dc13 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:44.288455 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-bb0e91b4-1c30-4db4-a096-97666ee0dc13 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:44.449596 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-bb0e91b4-1c30-4db4-a096-97666ee0dc13 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:44.457912 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-bb0e91b4-1c30-4db4-a096-97666ee0dc13 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d" status: 200 len: 1321 microversion: 2.1 time: 0.184165 Jul 21 20:05:44.458801 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 95/176] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:44 2022] GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d => generated 1321 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:44.488377 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-fb15f869-07d6-4838-ada3-acabe2098d29 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:44.489381 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-fb15f869-07d6-4838-ada3-acabe2098d29 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:44.495494 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-fb15f869-07d6-4838-ada3-acabe2098d29 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:44.496017 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-fb15f869-07d6-4838-ada3-acabe2098d29 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:44.497149 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-fb15f869-07d6-4838-ada3-acabe2098d29 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:44.497736 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-fb15f869-07d6-4838-ada3-acabe2098d29 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:44.508695 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-6676bbee-7a3f-4755-9ca2-13f295d80a07 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:44.509449 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-6676bbee-7a3f-4755-9ca2-13f295d80a07 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] [instance: 3c7c536b-2058-4226-938c-65ec0ad3dddc] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:44.516028 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6676bbee-7a3f-4755-9ca2-13f295d80a07 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:44.516758 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6676bbee-7a3f-4755-9ca2-13f295d80a07 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:44.517862 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6676bbee-7a3f-4755-9ca2-13f295d80a07 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:44.518375 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6676bbee-7a3f-4755-9ca2-13f295d80a07 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:44.642276 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-fb15f869-07d6-4838-ada3-acabe2098d29 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:44.651332 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-fb15f869-07d6-4838-ada3-acabe2098d29 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:44.653674 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-fb15f869-07d6-4838-ada3-acabe2098d29 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:44.655156 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-fb15f869-07d6-4838-ada3-acabe2098d29 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1406 microversion: 2.20 time: 0.173065 Jul 21 20:05:44.660846 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 82/177] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:05:44 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1406 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 20:05:44.662962 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-6676bbee-7a3f-4755-9ca2-13f295d80a07 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0100323b16c045b98dec585b9e59f077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc40ec656240410e862fde9531e0fc55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:44.670313 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-6676bbee-7a3f-4755-9ca2-13f295d80a07 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] 10.222.0.58 "GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc" status: 200 len: 1314 microversion: 2.1 time: 0.165428 Jul 21 20:05:44.670864 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 96/178] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:44 2022] GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:45.021774 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-f1dbbdc0-c719-41a0-8076-ecc3ba503915 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:45.022523 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-f1dbbdc0-c719-41a0-8076-ecc3ba503915 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 8f00566b-862b-4171-9259-b12aaa7ea030] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:45.028599 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f1dbbdc0-c719-41a0-8076-ecc3ba503915 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:45.029287 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f1dbbdc0-c719-41a0-8076-ecc3ba503915 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:45.029879 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f1dbbdc0-c719-41a0-8076-ecc3ba503915 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:45.030217 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f1dbbdc0-c719-41a0-8076-ecc3ba503915 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:45.185735 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-f1dbbdc0-c719-41a0-8076-ecc3ba503915 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:45.194168 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-f1dbbdc0-c719-41a0-8076-ecc3ba503915 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030" status: 200 len: 1366 microversion: 2.1 time: 0.176729 Jul 21 20:05:45.194832 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 83/179] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:45 2022] GET /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030 => generated 1366 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:45.231610 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-c73fef74-2bac-4440-9704-bfcf69612c32 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:45.232234 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-c73fef74-2bac-4440-9704-bfcf69612c32 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:45.239216 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c73fef74-2bac-4440-9704-bfcf69612c32 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:45.239884 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c73fef74-2bac-4440-9704-bfcf69612c32 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:45.244767 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c73fef74-2bac-4440-9704-bfcf69612c32 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:45.244767 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c73fef74-2bac-4440-9704-bfcf69612c32 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:45.393248 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-c73fef74-2bac-4440-9704-bfcf69612c32 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:45.405488 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-c73fef74-2bac-4440-9704-bfcf69612c32 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a" status: 200 len: 1362 microversion: 2.1 time: 0.175256 Jul 21 20:05:45.405488 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 97/180] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:45 2022] GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a => generated 1362 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:45.475009 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-39f645fc-5868-45ed-aa81-6a420d6b4e8c tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:45.476239 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-39f645fc-5868-45ed-aa81-6a420d6b4e8c tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 514a7771-fbf2-46db-9e3d-905a6a3e703d] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:45.482857 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-39f645fc-5868-45ed-aa81-6a420d6b4e8c tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:45.483346 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-39f645fc-5868-45ed-aa81-6a420d6b4e8c tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:45.484148 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-39f645fc-5868-45ed-aa81-6a420d6b4e8c tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:45.485566 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-39f645fc-5868-45ed-aa81-6a420d6b4e8c tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:45.645600 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-39f645fc-5868-45ed-aa81-6a420d6b4e8c tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:45.655331 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-39f645fc-5868-45ed-aa81-6a420d6b4e8c tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d" status: 200 len: 1321 microversion: 2.1 time: 0.184073 Jul 21 20:05:45.655946 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 84/181] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:45 2022] GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d => generated 1321 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:45.688559 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-a7130983-4285-470c-b6cb-7923d6a32739 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:45.689114 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-a7130983-4285-470c-b6cb-7923d6a32739 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:45.707171 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a7130983-4285-470c-b6cb-7923d6a32739 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:45.707625 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a7130983-4285-470c-b6cb-7923d6a32739 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:45.708399 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a7130983-4285-470c-b6cb-7923d6a32739 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:45.708824 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a7130983-4285-470c-b6cb-7923d6a32739 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:45.717429 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-abc822ed-6366-402a-a3e0-a72375b73150 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:45.718386 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-abc822ed-6366-402a-a3e0-a72375b73150 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] [instance: 3c7c536b-2058-4226-938c-65ec0ad3dddc] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:45.725523 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-abc822ed-6366-402a-a3e0-a72375b73150 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:45.726367 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-abc822ed-6366-402a-a3e0-a72375b73150 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:45.728172 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-abc822ed-6366-402a-a3e0-a72375b73150 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:45.728793 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-abc822ed-6366-402a-a3e0-a72375b73150 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:45.873534 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-a7130983-4285-470c-b6cb-7923d6a32739 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:45.882584 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-a7130983-4285-470c-b6cb-7923d6a32739 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:45.884132 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-a7130983-4285-470c-b6cb-7923d6a32739 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:45.885410 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-a7130983-4285-470c-b6cb-7923d6a32739 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1406 microversion: 2.20 time: 0.212234 Jul 21 20:05:45.885967 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 98/182] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:05:45 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1406 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:05:45.895621 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-abc822ed-6366-402a-a3e0-a72375b73150 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0100323b16c045b98dec585b9e59f077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc40ec656240410e862fde9531e0fc55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:45.903170 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-abc822ed-6366-402a-a3e0-a72375b73150 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] 10.222.0.58 "GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc" status: 200 len: 1314 microversion: 2.1 time: 0.208357 Jul 21 20:05:45.907137 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 85/183] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:45 2022] GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:46.212289 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-de37a45e-9aef-45e1-a059-fd1dd7451c31 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:46.212289 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-de37a45e-9aef-45e1-a059-fd1dd7451c31 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 8f00566b-862b-4171-9259-b12aaa7ea030] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:46.218466 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-de37a45e-9aef-45e1-a059-fd1dd7451c31 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:46.218908 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-de37a45e-9aef-45e1-a059-fd1dd7451c31 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:46.219705 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-de37a45e-9aef-45e1-a059-fd1dd7451c31 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:46.220136 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-de37a45e-9aef-45e1-a059-fd1dd7451c31 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:46.363853 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-de37a45e-9aef-45e1-a059-fd1dd7451c31 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:46.371333 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-de37a45e-9aef-45e1-a059-fd1dd7451c31 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030" status: 200 len: 1366 microversion: 2.1 time: 0.164408 Jul 21 20:05:46.373953 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 99/184] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:46 2022] GET /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:46.420883 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-4eeb14a2-e819-49ee-826e-12e78bcbc5ad tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:46.421490 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-4eeb14a2-e819-49ee-826e-12e78bcbc5ad tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:46.428011 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-4eeb14a2-e819-49ee-826e-12e78bcbc5ad tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:46.428455 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-4eeb14a2-e819-49ee-826e-12e78bcbc5ad tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:46.429205 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-4eeb14a2-e819-49ee-826e-12e78bcbc5ad tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:46.429634 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-4eeb14a2-e819-49ee-826e-12e78bcbc5ad tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:46.560165 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-4eeb14a2-e819-49ee-826e-12e78bcbc5ad tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:46.567933 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-4eeb14a2-e819-49ee-826e-12e78bcbc5ad tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a" status: 200 len: 1362 microversion: 2.1 time: 0.151015 Jul 21 20:05:46.568497 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 86/185] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:46 2022] GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:46.672894 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-37d1be14-daf1-45af-93f1-03380ca85e57 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:46.673709 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-37d1be14-daf1-45af-93f1-03380ca85e57 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 514a7771-fbf2-46db-9e3d-905a6a3e703d] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:46.680057 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-37d1be14-daf1-45af-93f1-03380ca85e57 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:46.680655 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-37d1be14-daf1-45af-93f1-03380ca85e57 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:46.681346 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-37d1be14-daf1-45af-93f1-03380ca85e57 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:46.681897 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-37d1be14-daf1-45af-93f1-03380ca85e57 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:46.819876 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-37d1be14-daf1-45af-93f1-03380ca85e57 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:46.827798 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-37d1be14-daf1-45af-93f1-03380ca85e57 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d" status: 200 len: 1321 microversion: 2.1 time: 0.159088 Jul 21 20:05:46.828421 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 100/186] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:46 2022] GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:46.904569 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-ae62fa56-8bd8-4c44-bd00-4ce32723f5e0 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:46.905158 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-ae62fa56-8bd8-4c44-bd00-4ce32723f5e0 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:46.916674 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-ae62fa56-8bd8-4c44-bd00-4ce32723f5e0 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:46.916674 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-ae62fa56-8bd8-4c44-bd00-4ce32723f5e0 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:46.927890 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-ae62fa56-8bd8-4c44-bd00-4ce32723f5e0 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:46.928343 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-ae62fa56-8bd8-4c44-bd00-4ce32723f5e0 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:46.929322 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-02522923-9503-404d-8423-ef4a49243c92 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:46.931938 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-02522923-9503-404d-8423-ef4a49243c92 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] [instance: 3c7c536b-2058-4226-938c-65ec0ad3dddc] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:46.955193 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-02522923-9503-404d-8423-ef4a49243c92 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:46.960068 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-02522923-9503-404d-8423-ef4a49243c92 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:46.960068 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-02522923-9503-404d-8423-ef4a49243c92 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:46.960068 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-02522923-9503-404d-8423-ef4a49243c92 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:47.262609 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-ae62fa56-8bd8-4c44-bd00-4ce32723f5e0 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:47.272282 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-ae62fa56-8bd8-4c44-bd00-4ce32723f5e0 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:47.278585 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-ae62fa56-8bd8-4c44-bd00-4ce32723f5e0 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:47.280220 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-ae62fa56-8bd8-4c44-bd00-4ce32723f5e0 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1406 microversion: 2.20 time: 0.379848 Jul 21 20:05:47.281326 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 87/187] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:05:46 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1406 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:05:47.354268 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-02522923-9503-404d-8423-ef4a49243c92 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0100323b16c045b98dec585b9e59f077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc40ec656240410e862fde9531e0fc55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:47.361894 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-02522923-9503-404d-8423-ef4a49243c92 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] 10.222.0.58 "GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc" status: 200 len: 1314 microversion: 2.1 time: 0.444076 Jul 21 20:05:47.363012 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 101/188] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:46 2022] GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc => generated 1314 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:47.389125 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-4fb4b2e8-bd05-42ac-9737-b9f9c2db91b8 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:47.393895 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-4fb4b2e8-bd05-42ac-9737-b9f9c2db91b8 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 8f00566b-862b-4171-9259-b12aaa7ea030] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:47.398861 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-4fb4b2e8-bd05-42ac-9737-b9f9c2db91b8 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:47.399330 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-4fb4b2e8-bd05-42ac-9737-b9f9c2db91b8 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:47.400232 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-4fb4b2e8-bd05-42ac-9737-b9f9c2db91b8 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:47.400805 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-4fb4b2e8-bd05-42ac-9737-b9f9c2db91b8 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:47.477620 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [req-6c2c529d-c789-4840-9a1f-1f8b74965f65 req-ea4ea3a2-7856-4ac6-9886-22f24199b635 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "514a7771-fbf2-46db-9e3d-905a6a3e703d", "name": "network-vif-plugged", "status": "completed", "tag": "fbb80a34-19c6-45c1-858e-6d36cec0a5b8"}]} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:05:47.490083 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-6c2c529d-c789-4840-9a1f-1f8b74965f65 req-ea4ea3a2-7856-4ac6-9886-22f24199b635 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:47.490516 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-6c2c529d-c789-4840-9a1f-1f8b74965f65 req-ea4ea3a2-7856-4ac6-9886-22f24199b635 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:47.504526 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.compute.server_external_events [req-6c2c529d-c789-4840-9a1f-1f8b74965f65 req-ea4ea3a2-7856-4ac6-9886-22f24199b635 service nova] Creating event network-vif-plugged:fbb80a34-19c6-45c1-858e-6d36cec0a5b8 for instance 514a7771-fbf2-46db-9e3d-905a6a3e703d on hv-cinder-85054 Jul 21 20:05:47.509848 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [req-6c2c529d-c789-4840-9a1f-1f8b74965f65 req-ea4ea3a2-7856-4ac6-9886-22f24199b635 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037665 Jul 21 20:05:47.510448 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 102/189] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 20:05:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 20:05:47.562304 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-4fb4b2e8-bd05-42ac-9737-b9f9c2db91b8 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:47.567999 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG dbcounter [-] [118344] Writing DB stats nova_cell1:SELECT=100 {{(pid=118344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:05:47.574143 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-4fb4b2e8-bd05-42ac-9737-b9f9c2db91b8 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030" status: 200 len: 1366 microversion: 2.1 time: 0.189097 Jul 21 20:05:47.574924 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 88/190] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:47 2022] GET /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030 => generated 1366 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:47.584812 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-d890727e-b4ca-4115-aea8-f7f511819f6a tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:47.585532 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-d890727e-b4ca-4115-aea8-f7f511819f6a tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:47.592452 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d890727e-b4ca-4115-aea8-f7f511819f6a tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:47.592896 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d890727e-b4ca-4115-aea8-f7f511819f6a tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:47.593896 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d890727e-b4ca-4115-aea8-f7f511819f6a tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:47.594532 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d890727e-b4ca-4115-aea8-f7f511819f6a tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:47.777444 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-d890727e-b4ca-4115-aea8-f7f511819f6a tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:47.785742 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-d890727e-b4ca-4115-aea8-f7f511819f6a tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a" status: 200 len: 1362 microversion: 2.1 time: 0.205226 Jul 21 20:05:47.786315 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 103/191] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:47 2022] GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a => generated 1362 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:47.844724 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-cae7cb0d-d762-4b0e-bcdc-04abbb46b027 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:47.845441 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-cae7cb0d-d762-4b0e-bcdc-04abbb46b027 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 514a7771-fbf2-46db-9e3d-905a6a3e703d] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:47.852306 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-cae7cb0d-d762-4b0e-bcdc-04abbb46b027 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:47.852752 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-cae7cb0d-d762-4b0e-bcdc-04abbb46b027 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:47.853513 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-cae7cb0d-d762-4b0e-bcdc-04abbb46b027 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:47.854012 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-cae7cb0d-d762-4b0e-bcdc-04abbb46b027 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:47.992301 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-cae7cb0d-d762-4b0e-bcdc-04abbb46b027 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:48.000378 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-cae7cb0d-d762-4b0e-bcdc-04abbb46b027 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d" status: 200 len: 1321 microversion: 2.1 time: 0.159782 Jul 21 20:05:48.000962 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 89/192] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:47 2022] GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:48.299202 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-fa961cc3-4ce9-49f6-a351-8446c6ac25cc tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:48.299732 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-fa961cc3-4ce9-49f6-a351-8446c6ac25cc tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:48.306373 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-fa961cc3-4ce9-49f6-a351-8446c6ac25cc tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:48.311874 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-fa961cc3-4ce9-49f6-a351-8446c6ac25cc tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:48.311874 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-fa961cc3-4ce9-49f6-a351-8446c6ac25cc tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:48.311874 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-fa961cc3-4ce9-49f6-a351-8446c6ac25cc tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:48.380656 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-cb58528c-c5ad-4198-ac42-3b34d1a20804 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:48.381274 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-cb58528c-c5ad-4198-ac42-3b34d1a20804 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] [instance: 3c7c536b-2058-4226-938c-65ec0ad3dddc] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:48.387801 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-cb58528c-c5ad-4198-ac42-3b34d1a20804 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:48.388251 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-cb58528c-c5ad-4198-ac42-3b34d1a20804 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:48.389019 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-cb58528c-c5ad-4198-ac42-3b34d1a20804 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:48.389613 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-cb58528c-c5ad-4198-ac42-3b34d1a20804 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:48.446685 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-fa961cc3-4ce9-49f6-a351-8446c6ac25cc tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:48.455135 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-fa961cc3-4ce9-49f6-a351-8446c6ac25cc tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:48.457307 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-fa961cc3-4ce9-49f6-a351-8446c6ac25cc tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:48.458411 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-fa961cc3-4ce9-49f6-a351-8446c6ac25cc tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1406 microversion: 2.20 time: 0.163191 Jul 21 20:05:48.458981 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 104/193] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:05:48 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:05:48.520285 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-cb58528c-c5ad-4198-ac42-3b34d1a20804 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0100323b16c045b98dec585b9e59f077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc40ec656240410e862fde9531e0fc55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:48.527652 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-cb58528c-c5ad-4198-ac42-3b34d1a20804 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] 10.222.0.58 "GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc" status: 200 len: 1314 microversion: 2.1 time: 0.150873 Jul 21 20:05:48.528276 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 90/194] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:48 2022] GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:05:48.592043 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-a92d953a-7cc8-4a23-a27d-8f84c7fe4982 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:48.592835 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-a92d953a-7cc8-4a23-a27d-8f84c7fe4982 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 8f00566b-862b-4171-9259-b12aaa7ea030] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:48.599511 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a92d953a-7cc8-4a23-a27d-8f84c7fe4982 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:48.600031 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a92d953a-7cc8-4a23-a27d-8f84c7fe4982 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:48.600905 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a92d953a-7cc8-4a23-a27d-8f84c7fe4982 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:48.601408 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a92d953a-7cc8-4a23-a27d-8f84c7fe4982 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:48.738023 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-a92d953a-7cc8-4a23-a27d-8f84c7fe4982 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:48.746749 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-a92d953a-7cc8-4a23-a27d-8f84c7fe4982 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030" status: 200 len: 1366 microversion: 2.1 time: 0.158914 Jul 21 20:05:48.747663 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 105/195] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:48 2022] GET /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:48.802516 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-d1ea3602-2836-46c8-b3fc-2ed55cebfb08 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:48.803148 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-d1ea3602-2836-46c8-b3fc-2ed55cebfb08 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:48.809268 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-d1ea3602-2836-46c8-b3fc-2ed55cebfb08 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:48.809649 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-d1ea3602-2836-46c8-b3fc-2ed55cebfb08 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:48.810404 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-d1ea3602-2836-46c8-b3fc-2ed55cebfb08 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:48.810863 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-d1ea3602-2836-46c8-b3fc-2ed55cebfb08 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:48.953812 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-d1ea3602-2836-46c8-b3fc-2ed55cebfb08 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:48.962144 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-d1ea3602-2836-46c8-b3fc-2ed55cebfb08 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a" status: 200 len: 1362 microversion: 2.1 time: 0.163244 Jul 21 20:05:48.962719 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 91/196] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:48 2022] GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:49.016707 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-0ef1d16a-d6bf-4113-b17e-0e74e984a321 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:49.017322 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-0ef1d16a-d6bf-4113-b17e-0e74e984a321 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 514a7771-fbf2-46db-9e3d-905a6a3e703d] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:49.023905 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0ef1d16a-d6bf-4113-b17e-0e74e984a321 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:49.024348 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0ef1d16a-d6bf-4113-b17e-0e74e984a321 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:49.028718 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0ef1d16a-d6bf-4113-b17e-0e74e984a321 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:49.028718 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0ef1d16a-d6bf-4113-b17e-0e74e984a321 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:49.171624 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-0ef1d16a-d6bf-4113-b17e-0e74e984a321 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:49.175415 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell1:SELECT=100 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:05:49.179884 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-0ef1d16a-d6bf-4113-b17e-0e74e984a321 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d" status: 200 len: 1321 microversion: 2.1 time: 0.167246 Jul 21 20:05:49.180579 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 106/197] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:49 2022] GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d => generated 1321 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:49.477516 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-201ebcf3-6bdb-4fc2-bdea-94f66191d15b tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:49.478115 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-201ebcf3-6bdb-4fc2-bdea-94f66191d15b tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:49.484519 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-201ebcf3-6bdb-4fc2-bdea-94f66191d15b tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:49.484959 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-201ebcf3-6bdb-4fc2-bdea-94f66191d15b tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:49.485789 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-201ebcf3-6bdb-4fc2-bdea-94f66191d15b tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:49.486216 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-201ebcf3-6bdb-4fc2-bdea-94f66191d15b tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:49.530112 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [req-307ad884-8800-4f08-8fc0-958901d03a0f req-68770f86-21d4-41d5-9d3e-1c8cd4b1a83c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f00566b-862b-4171-9259-b12aaa7ea030", "name": "network-vif-plugged", "status": "completed", "tag": "41ea78c8-2eb5-49db-9ee7-8b020833e0f8"}]} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:05:49.540112 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-307ad884-8800-4f08-8fc0-958901d03a0f req-68770f86-21d4-41d5-9d3e-1c8cd4b1a83c service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:49.540112 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-307ad884-8800-4f08-8fc0-958901d03a0f req-68770f86-21d4-41d5-9d3e-1c8cd4b1a83c service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:49.551930 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.compute.server_external_events [req-307ad884-8800-4f08-8fc0-958901d03a0f req-68770f86-21d4-41d5-9d3e-1c8cd4b1a83c service nova] Creating event network-vif-plugged:41ea78c8-2eb5-49db-9ee7-8b020833e0f8 for instance 8f00566b-862b-4171-9259-b12aaa7ea030 on hv-cinder-85054 Jul 21 20:05:49.557865 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [req-307ad884-8800-4f08-8fc0-958901d03a0f req-68770f86-21d4-41d5-9d3e-1c8cd4b1a83c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031399 Jul 21 20:05:49.558626 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 107/198] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 20:05:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:05:49.564000 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-7eaedaa7-44cf-4423-b01a-87b2de3284c7 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:49.564902 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-7eaedaa7-44cf-4423-b01a-87b2de3284c7 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] [instance: 3c7c536b-2058-4226-938c-65ec0ad3dddc] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:49.571049 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-7eaedaa7-44cf-4423-b01a-87b2de3284c7 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:49.571497 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-7eaedaa7-44cf-4423-b01a-87b2de3284c7 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:49.572314 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-7eaedaa7-44cf-4423-b01a-87b2de3284c7 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:49.572903 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-7eaedaa7-44cf-4423-b01a-87b2de3284c7 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:49.671058 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-201ebcf3-6bdb-4fc2-bdea-94f66191d15b tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:49.681186 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-201ebcf3-6bdb-4fc2-bdea-94f66191d15b tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:49.683102 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-201ebcf3-6bdb-4fc2-bdea-94f66191d15b tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:49.684341 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-201ebcf3-6bdb-4fc2-bdea-94f66191d15b tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1406 microversion: 2.20 time: 0.210764 Jul 21 20:05:49.685065 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 92/199] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:05:49 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1406 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:05:49.764830 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-cd2c4c6e-488f-4809-a9ef-9d9102c66a27 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:49.766466 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-cd2c4c6e-488f-4809-a9ef-9d9102c66a27 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 8f00566b-862b-4171-9259-b12aaa7ea030] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:49.770981 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-7eaedaa7-44cf-4423-b01a-87b2de3284c7 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0100323b16c045b98dec585b9e59f077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc40ec656240410e862fde9531e0fc55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:49.779310 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-7eaedaa7-44cf-4423-b01a-87b2de3284c7 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] 10.222.0.58 "GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc" status: 200 len: 1314 microversion: 2.1 time: 0.219385 Jul 21 20:05:49.782419 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 108/200] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:49 2022] GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:49.782545 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-cd2c4c6e-488f-4809-a9ef-9d9102c66a27 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:49.782545 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-cd2c4c6e-488f-4809-a9ef-9d9102c66a27 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:49.782545 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-cd2c4c6e-488f-4809-a9ef-9d9102c66a27 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:49.782545 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-cd2c4c6e-488f-4809-a9ef-9d9102c66a27 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:49.968547 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-cd2c4c6e-488f-4809-a9ef-9d9102c66a27 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:49.981839 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-9ff75b3a-3e9c-4cdc-b6c5-48c330eb01fe tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:49.982577 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-9ff75b3a-3e9c-4cdc-b6c5-48c330eb01fe tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:49.986237 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-cd2c4c6e-488f-4809-a9ef-9d9102c66a27 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030" status: 200 len: 1366 microversion: 2.1 time: 0.225430 Jul 21 20:05:49.988619 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 93/201] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:49 2022] GET /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030 => generated 1366 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:49.991396 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-9ff75b3a-3e9c-4cdc-b6c5-48c330eb01fe tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:49.991900 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-9ff75b3a-3e9c-4cdc-b6c5-48c330eb01fe tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:49.992940 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-9ff75b3a-3e9c-4cdc-b6c5-48c330eb01fe tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:49.993525 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-9ff75b3a-3e9c-4cdc-b6c5-48c330eb01fe tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:50.160992 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-9ff75b3a-3e9c-4cdc-b6c5-48c330eb01fe tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:50.169518 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-9ff75b3a-3e9c-4cdc-b6c5-48c330eb01fe tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a" status: 200 len: 1362 microversion: 2.1 time: 0.193853 Jul 21 20:05:50.170143 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 109/202] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:49 2022] GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a => generated 1362 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:05:50.197489 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-f82f1627-27ec-44ce-84ad-0cb99e690acd tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:50.198196 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-f82f1627-27ec-44ce-84ad-0cb99e690acd tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 514a7771-fbf2-46db-9e3d-905a6a3e703d] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:50.205047 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f82f1627-27ec-44ce-84ad-0cb99e690acd tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:50.205561 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f82f1627-27ec-44ce-84ad-0cb99e690acd tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:50.206969 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f82f1627-27ec-44ce-84ad-0cb99e690acd tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:50.207558 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f82f1627-27ec-44ce-84ad-0cb99e690acd tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:50.340294 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-f82f1627-27ec-44ce-84ad-0cb99e690acd tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:50.348176 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-f82f1627-27ec-44ce-84ad-0cb99e690acd tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d" status: 200 len: 1321 microversion: 2.1 time: 0.154636 Jul 21 20:05:50.348905 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 94/203] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:50 2022] GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:50.703332 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-18f8ee15-1454-4dad-b530-6b46faa2ae41 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:50.703944 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-18f8ee15-1454-4dad-b530-6b46faa2ae41 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:50.710382 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-18f8ee15-1454-4dad-b530-6b46faa2ae41 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:50.710866 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-18f8ee15-1454-4dad-b530-6b46faa2ae41 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:50.711655 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-18f8ee15-1454-4dad-b530-6b46faa2ae41 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:50.712090 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-18f8ee15-1454-4dad-b530-6b46faa2ae41 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:50.796065 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-de410275-16e0-45ee-b3d5-b49779070d8b tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:50.796985 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-de410275-16e0-45ee-b3d5-b49779070d8b tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] [instance: 3c7c536b-2058-4226-938c-65ec0ad3dddc] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:50.806107 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-de410275-16e0-45ee-b3d5-b49779070d8b tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:50.806730 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-de410275-16e0-45ee-b3d5-b49779070d8b tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:50.808468 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-de410275-16e0-45ee-b3d5-b49779070d8b tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:50.808468 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-de410275-16e0-45ee-b3d5-b49779070d8b tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:50.860225 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-18f8ee15-1454-4dad-b530-6b46faa2ae41 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:50.868754 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-18f8ee15-1454-4dad-b530-6b46faa2ae41 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:50.870481 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-18f8ee15-1454-4dad-b530-6b46faa2ae41 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:50.871626 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-18f8ee15-1454-4dad-b530-6b46faa2ae41 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1406 microversion: 2.20 time: 0.172908 Jul 21 20:05:50.872186 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 110/204] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:05:50 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1406 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:05:50.961340 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-de410275-16e0-45ee-b3d5-b49779070d8b tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0100323b16c045b98dec585b9e59f077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc40ec656240410e862fde9531e0fc55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:50.969131 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-de410275-16e0-45ee-b3d5-b49779070d8b tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] 10.222.0.58 "GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc" status: 200 len: 1314 microversion: 2.1 time: 0.177235 Jul 21 20:05:50.969752 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 95/205] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:50 2022] GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:05:51.012738 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-3aa2ed67-58df-45b0-9b20-c0f892f1b60b tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:51.013368 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-3aa2ed67-58df-45b0-9b20-c0f892f1b60b tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 8f00566b-862b-4171-9259-b12aaa7ea030] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:51.019677 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3aa2ed67-58df-45b0-9b20-c0f892f1b60b tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:51.020122 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3aa2ed67-58df-45b0-9b20-c0f892f1b60b tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:51.020877 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3aa2ed67-58df-45b0-9b20-c0f892f1b60b tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:51.021308 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3aa2ed67-58df-45b0-9b20-c0f892f1b60b tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:51.190532 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-57f3c057-6fde-4b7a-84fe-5155a9ecfca2 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:51.190532 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-57f3c057-6fde-4b7a-84fe-5155a9ecfca2 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:51.195942 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-3aa2ed67-58df-45b0-9b20-c0f892f1b60b tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:51.200609 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-57f3c057-6fde-4b7a-84fe-5155a9ecfca2 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:51.201385 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-57f3c057-6fde-4b7a-84fe-5155a9ecfca2 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:51.202247 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-57f3c057-6fde-4b7a-84fe-5155a9ecfca2 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:51.202692 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-57f3c057-6fde-4b7a-84fe-5155a9ecfca2 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:51.203762 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-3aa2ed67-58df-45b0-9b20-c0f892f1b60b tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030" status: 200 len: 1366 microversion: 2.1 time: 0.194891 Jul 21 20:05:51.204346 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 111/206] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:51 2022] GET /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030 => generated 1366 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:05:51.365460 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-544ddc7d-ce4f-4ee7-9e1a-855929022d7a tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:51.366074 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-544ddc7d-ce4f-4ee7-9e1a-855929022d7a tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 514a7771-fbf2-46db-9e3d-905a6a3e703d] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:51.372237 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-544ddc7d-ce4f-4ee7-9e1a-855929022d7a tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:51.372680 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-544ddc7d-ce4f-4ee7-9e1a-855929022d7a tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:51.373587 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-544ddc7d-ce4f-4ee7-9e1a-855929022d7a tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:51.374025 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-544ddc7d-ce4f-4ee7-9e1a-855929022d7a tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:51.415963 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-57f3c057-6fde-4b7a-84fe-5155a9ecfca2 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:51.433156 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-57f3c057-6fde-4b7a-84fe-5155a9ecfca2 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a" status: 200 len: 1362 microversion: 2.1 time: 0.249642 Jul 21 20:05:51.438524 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 96/207] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:51 2022] GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a => generated 1362 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:51.568739 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-544ddc7d-ce4f-4ee7-9e1a-855929022d7a tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:51.576469 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-544ddc7d-ce4f-4ee7-9e1a-855929022d7a tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d" status: 200 len: 1321 microversion: 2.1 time: 0.215477 Jul 21 20:05:51.576978 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 112/208] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:51 2022] GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d => generated 1321 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:05:51.895835 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-14beec99-b1f6-4f73-866c-cab79e7749d9 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:51.895835 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-14beec99-b1f6-4f73-866c-cab79e7749d9 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:51.904989 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-14beec99-b1f6-4f73-866c-cab79e7749d9 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:51.905704 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-14beec99-b1f6-4f73-866c-cab79e7749d9 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:51.906821 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-14beec99-b1f6-4f73-866c-cab79e7749d9 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:51.907369 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-14beec99-b1f6-4f73-866c-cab79e7749d9 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:51.988009 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-5e25d817-233d-4a5a-b5f4-ebf2a591ec9f tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:51.988741 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-5e25d817-233d-4a5a-b5f4-ebf2a591ec9f tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] [instance: 3c7c536b-2058-4226-938c-65ec0ad3dddc] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:51.997345 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5e25d817-233d-4a5a-b5f4-ebf2a591ec9f tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:51.997789 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5e25d817-233d-4a5a-b5f4-ebf2a591ec9f tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:51.998644 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5e25d817-233d-4a5a-b5f4-ebf2a591ec9f tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:52.002781 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5e25d817-233d-4a5a-b5f4-ebf2a591ec9f tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:52.113165 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-14beec99-b1f6-4f73-866c-cab79e7749d9 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:52.121667 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-14beec99-b1f6-4f73-866c-cab79e7749d9 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:52.123326 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-14beec99-b1f6-4f73-866c-cab79e7749d9 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:52.124617 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-14beec99-b1f6-4f73-866c-cab79e7749d9 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1406 microversion: 2.20 time: 0.236253 Jul 21 20:05:52.125302 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 97/209] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:05:51 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1406 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:05:52.160799 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-5e25d817-233d-4a5a-b5f4-ebf2a591ec9f tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0100323b16c045b98dec585b9e59f077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc40ec656240410e862fde9531e0fc55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:52.168580 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-5e25d817-233d-4a5a-b5f4-ebf2a591ec9f tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] 10.222.0.58 "GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc" status: 200 len: 1314 microversion: 2.1 time: 0.185187 Jul 21 20:05:52.169261 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 113/210] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:51 2022] GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:05:52.220847 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-50538c0b-ee7a-4362-8087-b1ae8ed237e9 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:52.221549 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-50538c0b-ee7a-4362-8087-b1ae8ed237e9 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 8f00566b-862b-4171-9259-b12aaa7ea030] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:52.228147 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-50538c0b-ee7a-4362-8087-b1ae8ed237e9 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:52.228585 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-50538c0b-ee7a-4362-8087-b1ae8ed237e9 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:52.229339 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-50538c0b-ee7a-4362-8087-b1ae8ed237e9 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:52.229758 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-50538c0b-ee7a-4362-8087-b1ae8ed237e9 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:52.453079 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-9c0b3e19-b571-4794-bc72-0f0220d61cc8 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:52.453951 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-9c0b3e19-b571-4794-bc72-0f0220d61cc8 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:52.461661 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-9c0b3e19-b571-4794-bc72-0f0220d61cc8 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:52.462300 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-9c0b3e19-b571-4794-bc72-0f0220d61cc8 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:52.463716 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-9c0b3e19-b571-4794-bc72-0f0220d61cc8 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:52.464149 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-9c0b3e19-b571-4794-bc72-0f0220d61cc8 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:52.567408 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-50538c0b-ee7a-4362-8087-b1ae8ed237e9 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:52.584042 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-50538c0b-ee7a-4362-8087-b1ae8ed237e9 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030" status: 200 len: 1366 microversion: 2.1 time: 0.364496 Jul 21 20:05:52.588494 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 98/211] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:52 2022] GET /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030 => generated 1366 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:52.602101 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-27c4c78c-d4c6-44a8-aeac-0dfcd7a153c1 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:52.602728 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-27c4c78c-d4c6-44a8-aeac-0dfcd7a153c1 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 514a7771-fbf2-46db-9e3d-905a6a3e703d] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:52.616224 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-27c4c78c-d4c6-44a8-aeac-0dfcd7a153c1 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:52.617089 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-27c4c78c-d4c6-44a8-aeac-0dfcd7a153c1 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:52.618088 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-27c4c78c-d4c6-44a8-aeac-0dfcd7a153c1 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:52.618735 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-27c4c78c-d4c6-44a8-aeac-0dfcd7a153c1 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:52.784834 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-9c0b3e19-b571-4794-bc72-0f0220d61cc8 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:52.801872 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-9c0b3e19-b571-4794-bc72-0f0220d61cc8 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a" status: 200 len: 1362 microversion: 2.1 time: 0.353428 Jul 21 20:05:52.803000 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 114/212] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:52 2022] GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a => generated 1362 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:05:52.832969 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-27c4c78c-d4c6-44a8-aeac-0dfcd7a153c1 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:52.844929 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-27c4c78c-d4c6-44a8-aeac-0dfcd7a153c1 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d" status: 200 len: 1321 microversion: 2.1 time: 0.251147 Jul 21 20:05:52.844929 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 99/213] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:52 2022] GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d => generated 1321 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:53.142182 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-56247e1d-ba44-4d48-bdd5-3bba4f2305d1 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:53.142950 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-56247e1d-ba44-4d48-bdd5-3bba4f2305d1 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:53.150743 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-56247e1d-ba44-4d48-bdd5-3bba4f2305d1 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:53.151234 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-56247e1d-ba44-4d48-bdd5-3bba4f2305d1 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:53.152227 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-56247e1d-ba44-4d48-bdd5-3bba4f2305d1 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:53.152665 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-56247e1d-ba44-4d48-bdd5-3bba4f2305d1 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:53.185423 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-858053f2-06f6-4207-9ed7-f9b207bf7a49 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:53.186044 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-858053f2-06f6-4207-9ed7-f9b207bf7a49 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] [instance: 3c7c536b-2058-4226-938c-65ec0ad3dddc] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:53.198031 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-858053f2-06f6-4207-9ed7-f9b207bf7a49 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:53.201683 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-858053f2-06f6-4207-9ed7-f9b207bf7a49 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:53.202534 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-858053f2-06f6-4207-9ed7-f9b207bf7a49 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:53.203068 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-858053f2-06f6-4207-9ed7-f9b207bf7a49 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:53.329735 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-56247e1d-ba44-4d48-bdd5-3bba4f2305d1 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:53.349165 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-56247e1d-ba44-4d48-bdd5-3bba4f2305d1 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:53.351140 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-56247e1d-ba44-4d48-bdd5-3bba4f2305d1 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:53.352607 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-56247e1d-ba44-4d48-bdd5-3bba4f2305d1 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1406 microversion: 2.20 time: 0.214844 Jul 21 20:05:53.353390 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 115/214] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:05:53 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1406 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:05:53.367003 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-858053f2-06f6-4207-9ed7-f9b207bf7a49 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0100323b16c045b98dec585b9e59f077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc40ec656240410e862fde9531e0fc55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:53.379583 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-858053f2-06f6-4207-9ed7-f9b207bf7a49 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] 10.222.0.58 "GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc" status: 200 len: 1314 microversion: 2.1 time: 0.193790 Jul 21 20:05:53.379583 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 100/215] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:53 2022] GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:53.483327 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [req-a34fbd34-c247-498e-980f-e1277881a0bd req-410db848-f953-43b6-8356-7262fcca2b94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a615f10-936f-48d1-aad9-e414dc31d016", "name": "network-vif-plugged", "status": "completed", "tag": "a1660b17-172b-4784-a846-78546f7da506"}]} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:05:53.491579 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-a34fbd34-c247-498e-980f-e1277881a0bd req-410db848-f953-43b6-8356-7262fcca2b94 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:53.492075 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-a34fbd34-c247-498e-980f-e1277881a0bd req-410db848-f953-43b6-8356-7262fcca2b94 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:53.503493 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.compute.server_external_events [req-a34fbd34-c247-498e-980f-e1277881a0bd req-410db848-f953-43b6-8356-7262fcca2b94 service nova] Creating event network-vif-plugged:a1660b17-172b-4784-a846-78546f7da506 for instance 3a615f10-936f-48d1-aad9-e414dc31d016 on hv-cinder-85054 Jul 21 20:05:53.508461 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [req-a34fbd34-c247-498e-980f-e1277881a0bd req-410db848-f953-43b6-8356-7262fcca2b94 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028706 Jul 21 20:05:53.509066 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 116/216] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 20:05:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:05:53.602038 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-33aaad99-cf17-43aa-8305-e9c4a7e9f598 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:53.602862 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-33aaad99-cf17-43aa-8305-e9c4a7e9f598 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 8f00566b-862b-4171-9259-b12aaa7ea030] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:53.610762 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-33aaad99-cf17-43aa-8305-e9c4a7e9f598 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:53.611531 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-33aaad99-cf17-43aa-8305-e9c4a7e9f598 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:53.613005 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-33aaad99-cf17-43aa-8305-e9c4a7e9f598 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:53.613913 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-33aaad99-cf17-43aa-8305-e9c4a7e9f598 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:53.795408 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-33aaad99-cf17-43aa-8305-e9c4a7e9f598 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:53.807845 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-33aaad99-cf17-43aa-8305-e9c4a7e9f598 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030" status: 200 len: 1366 microversion: 2.1 time: 0.209157 Jul 21 20:05:53.818140 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 101/217] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:53 2022] GET /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030 => generated 1366 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:53.825365 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-7bdc1a55-d1ab-46bf-b9ef-b01a0d744e3c tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:53.826413 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-7bdc1a55-d1ab-46bf-b9ef-b01a0d744e3c tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:53.833612 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-7bdc1a55-d1ab-46bf-b9ef-b01a0d744e3c tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:53.833953 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-7bdc1a55-d1ab-46bf-b9ef-b01a0d744e3c tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:53.834803 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-7bdc1a55-d1ab-46bf-b9ef-b01a0d744e3c tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:53.835208 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-7bdc1a55-d1ab-46bf-b9ef-b01a0d744e3c tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:53.858106 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-de6b6518-380c-4364-8d10-296fc0374525 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:53.858708 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-de6b6518-380c-4364-8d10-296fc0374525 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 514a7771-fbf2-46db-9e3d-905a6a3e703d] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:53.866209 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-de6b6518-380c-4364-8d10-296fc0374525 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:53.866655 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-de6b6518-380c-4364-8d10-296fc0374525 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:53.868015 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-de6b6518-380c-4364-8d10-296fc0374525 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:53.868612 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-de6b6518-380c-4364-8d10-296fc0374525 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:54.004105 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-7bdc1a55-d1ab-46bf-b9ef-b01a0d744e3c tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:54.011828 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-7bdc1a55-d1ab-46bf-b9ef-b01a0d744e3c tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a" status: 200 len: 1362 microversion: 2.1 time: 0.190932 Jul 21 20:05:54.012147 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-de6b6518-380c-4364-8d10-296fc0374525 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:54.012561 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 117/218] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:53 2022] GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a => generated 1362 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:54.020232 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-de6b6518-380c-4364-8d10-296fc0374525 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d" status: 200 len: 1321 microversion: 2.1 time: 0.165940 Jul 21 20:05:54.020788 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 102/219] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:53 2022] GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d => generated 1321 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:05:54.370521 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-153c3a44-cb0f-46df-9732-deb367426b7f tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:54.370971 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-153c3a44-cb0f-46df-9732-deb367426b7f tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:54.377016 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-153c3a44-cb0f-46df-9732-deb367426b7f tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:54.377451 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-153c3a44-cb0f-46df-9732-deb367426b7f tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:54.378780 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-153c3a44-cb0f-46df-9732-deb367426b7f tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:54.379330 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-153c3a44-cb0f-46df-9732-deb367426b7f tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:54.394002 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-14862074-402a-4065-89e0-4eb0e99f64d1 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:54.394610 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-14862074-402a-4065-89e0-4eb0e99f64d1 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] [instance: 3c7c536b-2058-4226-938c-65ec0ad3dddc] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:54.403007 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-14862074-402a-4065-89e0-4eb0e99f64d1 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:54.403690 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-14862074-402a-4065-89e0-4eb0e99f64d1 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:54.404902 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-14862074-402a-4065-89e0-4eb0e99f64d1 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:54.407156 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-14862074-402a-4065-89e0-4eb0e99f64d1 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:54.530261 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-153c3a44-cb0f-46df-9732-deb367426b7f tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:54.540435 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-153c3a44-cb0f-46df-9732-deb367426b7f tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:54.542015 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-153c3a44-cb0f-46df-9732-deb367426b7f tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:54.543738 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-153c3a44-cb0f-46df-9732-deb367426b7f tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1406 microversion: 2.20 time: 0.177227 Jul 21 20:05:54.544771 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 118/220] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:05:54 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1406 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:05:54.557852 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-14862074-402a-4065-89e0-4eb0e99f64d1 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0100323b16c045b98dec585b9e59f077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc40ec656240410e862fde9531e0fc55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:54.565260 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-14862074-402a-4065-89e0-4eb0e99f64d1 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] 10.222.0.58 "GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc" status: 200 len: 1314 microversion: 2.1 time: 0.175147 Jul 21 20:05:54.565915 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 103/221] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:54 2022] GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:05:54.825705 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-82e53b34-60da-4e9a-baf6-27e61740a7b9 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:54.826372 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-82e53b34-60da-4e9a-baf6-27e61740a7b9 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 8f00566b-862b-4171-9259-b12aaa7ea030] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:54.832966 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-82e53b34-60da-4e9a-baf6-27e61740a7b9 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:54.836658 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-82e53b34-60da-4e9a-baf6-27e61740a7b9 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:54.836658 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-82e53b34-60da-4e9a-baf6-27e61740a7b9 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:54.836658 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-82e53b34-60da-4e9a-baf6-27e61740a7b9 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:54.962779 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-82e53b34-60da-4e9a-baf6-27e61740a7b9 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:54.971349 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-82e53b34-60da-4e9a-baf6-27e61740a7b9 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030" status: 200 len: 1366 microversion: 2.1 time: 0.149460 Jul 21 20:05:54.971929 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 119/222] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:54 2022] GET /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:55.028784 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-f09b954c-51e6-4144-889c-7096eea108f9 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:55.029430 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-f09b954c-51e6-4144-889c-7096eea108f9 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:55.036031 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f09b954c-51e6-4144-889c-7096eea108f9 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:55.036475 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f09b954c-51e6-4144-889c-7096eea108f9 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:55.037240 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f09b954c-51e6-4144-889c-7096eea108f9 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:55.037375 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-dd367e7b-d3be-4b19-adcd-4a771293e990 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:55.037666 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f09b954c-51e6-4144-889c-7096eea108f9 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:55.037977 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-dd367e7b-d3be-4b19-adcd-4a771293e990 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 514a7771-fbf2-46db-9e3d-905a6a3e703d] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:55.044123 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-dd367e7b-d3be-4b19-adcd-4a771293e990 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:55.044574 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-dd367e7b-d3be-4b19-adcd-4a771293e990 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:55.045369 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-dd367e7b-d3be-4b19-adcd-4a771293e990 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:55.045810 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-dd367e7b-d3be-4b19-adcd-4a771293e990 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:55.212668 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-dd367e7b-d3be-4b19-adcd-4a771293e990 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:55.216818 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-f09b954c-51e6-4144-889c-7096eea108f9 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:55.222521 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-dd367e7b-d3be-4b19-adcd-4a771293e990 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d" status: 200 len: 1321 microversion: 2.1 time: 0.187813 Jul 21 20:05:55.231900 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 120/223] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:55 2022] GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d => generated 1321 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:05:55.232367 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-f09b954c-51e6-4144-889c-7096eea108f9 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a" status: 200 len: 1362 microversion: 2.1 time: 0.201637 Jul 21 20:05:55.232367 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 104/224] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:55 2022] GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a => generated 1362 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:55.563510 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-c3ca07f4-9b6e-4e1b-89df-8058c3192f83 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:55.564257 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-c3ca07f4-9b6e-4e1b-89df-8058c3192f83 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:55.571939 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c3ca07f4-9b6e-4e1b-89df-8058c3192f83 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:55.572758 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c3ca07f4-9b6e-4e1b-89df-8058c3192f83 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:55.573782 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c3ca07f4-9b6e-4e1b-89df-8058c3192f83 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:55.574223 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c3ca07f4-9b6e-4e1b-89df-8058c3192f83 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:55.583819 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-1a384c8e-9ec0-4e7e-970e-45a98a887f53 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:55.584813 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-1a384c8e-9ec0-4e7e-970e-45a98a887f53 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] [instance: 3c7c536b-2058-4226-938c-65ec0ad3dddc] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:55.591193 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-1a384c8e-9ec0-4e7e-970e-45a98a887f53 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:55.592249 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-1a384c8e-9ec0-4e7e-970e-45a98a887f53 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:55.595666 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-1a384c8e-9ec0-4e7e-970e-45a98a887f53 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:55.595666 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-1a384c8e-9ec0-4e7e-970e-45a98a887f53 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:55.617354 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG dbcounter [-] [118344] Writing DB stats nova_cell1:SELECT=100 {{(pid=118344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:05:55.721843 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-c3ca07f4-9b6e-4e1b-89df-8058c3192f83 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:55.730249 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-c3ca07f4-9b6e-4e1b-89df-8058c3192f83 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:55.731887 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-c3ca07f4-9b6e-4e1b-89df-8058c3192f83 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:55.733170 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-c3ca07f4-9b6e-4e1b-89df-8058c3192f83 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1406 microversion: 2.20 time: 0.174081 Jul 21 20:05:55.733829 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 121/225] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:05:55 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1406 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:05:55.755700 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-1a384c8e-9ec0-4e7e-970e-45a98a887f53 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0100323b16c045b98dec585b9e59f077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc40ec656240410e862fde9531e0fc55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:55.763711 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-1a384c8e-9ec0-4e7e-970e-45a98a887f53 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] 10.222.0.58 "GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc" status: 200 len: 1314 microversion: 2.1 time: 0.185250 Jul 21 20:05:55.768198 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 105/226] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:55 2022] GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:05:55.989368 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-c6107d5c-7d7d-457f-9de6-71c5895044f3 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:55.989981 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-c6107d5c-7d7d-457f-9de6-71c5895044f3 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 8f00566b-862b-4171-9259-b12aaa7ea030] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:55.996633 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c6107d5c-7d7d-457f-9de6-71c5895044f3 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:55.997081 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c6107d5c-7d7d-457f-9de6-71c5895044f3 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:55.997850 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c6107d5c-7d7d-457f-9de6-71c5895044f3 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:55.998283 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c6107d5c-7d7d-457f-9de6-71c5895044f3 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:56.241219 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-9f1f091f-617b-486b-8db8-e706c9d5ef0c tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:56.241862 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-9f1f091f-617b-486b-8db8-e706c9d5ef0c tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 514a7771-fbf2-46db-9e3d-905a6a3e703d] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:56.248721 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-9f1f091f-617b-486b-8db8-e706c9d5ef0c tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:56.249553 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-9f1f091f-617b-486b-8db8-e706c9d5ef0c tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:56.250343 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-9f1f091f-617b-486b-8db8-e706c9d5ef0c tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:56.250831 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-9f1f091f-617b-486b-8db8-e706c9d5ef0c tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:56.451616 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-c6107d5c-7d7d-457f-9de6-71c5895044f3 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:56.460229 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-c6107d5c-7d7d-457f-9de6-71c5895044f3 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030" status: 200 len: 1366 microversion: 2.1 time: 0.475626 Jul 21 20:05:56.469911 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 122/227] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:55 2022] GET /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030 => generated 1366 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:56.469911 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-5a2e7694-72c8-420c-afa2-c112f8926e35 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:56.469911 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-5a2e7694-72c8-420c-afa2-c112f8926e35 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:56.475914 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5a2e7694-72c8-420c-afa2-c112f8926e35 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:56.476376 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5a2e7694-72c8-420c-afa2-c112f8926e35 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:56.477191 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5a2e7694-72c8-420c-afa2-c112f8926e35 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:56.477624 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5a2e7694-72c8-420c-afa2-c112f8926e35 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:56.624066 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-5a2e7694-72c8-420c-afa2-c112f8926e35 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:56.628973 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-9f1f091f-617b-486b-8db8-e706c9d5ef0c tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:56.632379 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-5a2e7694-72c8-420c-afa2-c112f8926e35 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a" status: 200 len: 1362 microversion: 2.1 time: 0.170413 Jul 21 20:05:56.632964 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 123/228] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:56 2022] GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:56.637100 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-9f1f091f-617b-486b-8db8-e706c9d5ef0c tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d" status: 200 len: 1321 microversion: 2.1 time: 0.401052 Jul 21 20:05:56.637730 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 106/229] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:56 2022] GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d => generated 1321 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:56.752398 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-c0ac9276-4996-4e82-acc6-dd5eb1ae7ec0 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:56.752981 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-c0ac9276-4996-4e82-acc6-dd5eb1ae7ec0 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:56.759180 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c0ac9276-4996-4e82-acc6-dd5eb1ae7ec0 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:56.759623 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c0ac9276-4996-4e82-acc6-dd5eb1ae7ec0 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:56.760409 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c0ac9276-4996-4e82-acc6-dd5eb1ae7ec0 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:56.760884 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c0ac9276-4996-4e82-acc6-dd5eb1ae7ec0 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:56.781525 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-bb1b4976-8d40-402d-9b20-7a5838e9db28 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:56.782150 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-bb1b4976-8d40-402d-9b20-7a5838e9db28 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] [instance: 3c7c536b-2058-4226-938c-65ec0ad3dddc] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:56.788808 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-bb1b4976-8d40-402d-9b20-7a5838e9db28 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:56.789254 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-bb1b4976-8d40-402d-9b20-7a5838e9db28 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:56.790025 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-bb1b4976-8d40-402d-9b20-7a5838e9db28 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:56.790461 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-bb1b4976-8d40-402d-9b20-7a5838e9db28 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:56.903781 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-c0ac9276-4996-4e82-acc6-dd5eb1ae7ec0 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:56.907702 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell1:SELECT=100 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:05:56.916129 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-c0ac9276-4996-4e82-acc6-dd5eb1ae7ec0 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:56.918732 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-c0ac9276-4996-4e82-acc6-dd5eb1ae7ec0 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:56.920511 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-c0ac9276-4996-4e82-acc6-dd5eb1ae7ec0 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1406 microversion: 2.20 time: 0.172080 Jul 21 20:05:56.921764 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 124/230] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:05:56 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1406 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:05:56.937483 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-bb1b4976-8d40-402d-9b20-7a5838e9db28 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0100323b16c045b98dec585b9e59f077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc40ec656240410e862fde9531e0fc55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:56.946514 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-bb1b4976-8d40-402d-9b20-7a5838e9db28 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] 10.222.0.58 "GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc" status: 200 len: 1314 microversion: 2.1 time: 0.168669 Jul 21 20:05:56.947141 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 107/231] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:56 2022] GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:05:57.477508 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-b537ab4b-1714-4c6e-9b4e-2df33a6bca1c tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:57.478118 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-b537ab4b-1714-4c6e-9b4e-2df33a6bca1c tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 8f00566b-862b-4171-9259-b12aaa7ea030] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:57.481270 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_api:SELECT=100 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:05:57.485423 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b537ab4b-1714-4c6e-9b4e-2df33a6bca1c tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:57.485869 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b537ab4b-1714-4c6e-9b4e-2df33a6bca1c tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:57.486631 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b537ab4b-1714-4c6e-9b4e-2df33a6bca1c tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:57.487090 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b537ab4b-1714-4c6e-9b4e-2df33a6bca1c tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:57.619858 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-b537ab4b-1714-4c6e-9b4e-2df33a6bca1c tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:57.627806 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-b537ab4b-1714-4c6e-9b4e-2df33a6bca1c tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030" status: 200 len: 1366 microversion: 2.1 time: 0.154487 Jul 21 20:05:57.628777 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 125/232] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:57 2022] GET /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:05:57.650193 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-589f92dd-8b77-4f05-ab47-78a9a3d2ef6a tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:57.650797 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-589f92dd-8b77-4f05-ab47-78a9a3d2ef6a tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:57.653337 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-145a21bb-f052-401e-9b2f-bade27295824 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:57.654101 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-145a21bb-f052-401e-9b2f-bade27295824 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 514a7771-fbf2-46db-9e3d-905a6a3e703d] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:57.656987 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-589f92dd-8b77-4f05-ab47-78a9a3d2ef6a tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:57.657427 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-589f92dd-8b77-4f05-ab47-78a9a3d2ef6a tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:57.658187 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-589f92dd-8b77-4f05-ab47-78a9a3d2ef6a tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:57.658615 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-589f92dd-8b77-4f05-ab47-78a9a3d2ef6a tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:57.664026 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-145a21bb-f052-401e-9b2f-bade27295824 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:57.664471 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-145a21bb-f052-401e-9b2f-bade27295824 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:57.665304 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-145a21bb-f052-401e-9b2f-bade27295824 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:57.665733 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-145a21bb-f052-401e-9b2f-bade27295824 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:57.795327 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-589f92dd-8b77-4f05-ab47-78a9a3d2ef6a tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:57.804466 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-589f92dd-8b77-4f05-ab47-78a9a3d2ef6a tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a" status: 200 len: 1362 microversion: 2.1 time: 0.158442 Jul 21 20:05:57.805042 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 108/233] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:57 2022] GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:57.805738 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-145a21bb-f052-401e-9b2f-bade27295824 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:57.814209 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-145a21bb-f052-401e-9b2f-bade27295824 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d" status: 200 len: 1321 microversion: 2.1 time: 0.164601 Jul 21 20:05:57.814948 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 126/234] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:57 2022] GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d => generated 1321 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:05:57.938536 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-a9c1a30e-af80-43f0-a508-503c12615ceb tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:57.939204 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-a9c1a30e-af80-43f0-a508-503c12615ceb tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:57.946967 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-a9c1a30e-af80-43f0-a508-503c12615ceb tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:57.947764 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-a9c1a30e-af80-43f0-a508-503c12615ceb tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:57.948537 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-a9c1a30e-af80-43f0-a508-503c12615ceb tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:57.948978 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-a9c1a30e-af80-43f0-a508-503c12615ceb tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:57.964785 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-920d02be-d4fb-4352-b3a0-07cf75d8784c tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:57.968598 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-920d02be-d4fb-4352-b3a0-07cf75d8784c tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] [instance: 3c7c536b-2058-4226-938c-65ec0ad3dddc] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:57.978839 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-920d02be-d4fb-4352-b3a0-07cf75d8784c tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:57.981116 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-920d02be-d4fb-4352-b3a0-07cf75d8784c tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:57.984058 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-920d02be-d4fb-4352-b3a0-07cf75d8784c tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:57.984491 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-920d02be-d4fb-4352-b3a0-07cf75d8784c tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:58.105363 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-a9c1a30e-af80-43f0-a508-503c12615ceb tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:58.115065 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-a9c1a30e-af80-43f0-a508-503c12615ceb tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:58.117081 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-a9c1a30e-af80-43f0-a508-503c12615ceb tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:58.118522 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-a9c1a30e-af80-43f0-a508-503c12615ceb tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1406 microversion: 2.20 time: 0.183978 Jul 21 20:05:58.119448 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 109/235] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:05:57 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1406 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:05:58.132687 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-920d02be-d4fb-4352-b3a0-07cf75d8784c tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0100323b16c045b98dec585b9e59f077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc40ec656240410e862fde9531e0fc55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:58.140053 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-920d02be-d4fb-4352-b3a0-07cf75d8784c tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] 10.222.0.58 "GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc" status: 200 len: 1501 microversion: 2.1 time: 0.179112 Jul 21 20:05:58.140766 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 127/236] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:57 2022] GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc => generated 1501 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:58.648078 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-b48625a6-0d25-4248-93f9-4a40de2c272e tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:58.648906 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-b48625a6-0d25-4248-93f9-4a40de2c272e tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 8f00566b-862b-4171-9259-b12aaa7ea030] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:58.655263 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-b48625a6-0d25-4248-93f9-4a40de2c272e tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:58.655854 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-b48625a6-0d25-4248-93f9-4a40de2c272e tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:58.656496 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-b48625a6-0d25-4248-93f9-4a40de2c272e tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:58.656928 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-b48625a6-0d25-4248-93f9-4a40de2c272e tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:58.797804 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-b48625a6-0d25-4248-93f9-4a40de2c272e tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:58.811005 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-b48625a6-0d25-4248-93f9-4a40de2c272e tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030" status: 200 len: 1366 microversion: 2.1 time: 0.169533 Jul 21 20:05:58.811775 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 110/237] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:58 2022] GET /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030 => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:58.821480 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-1f89efa9-209b-4faa-9455-15335bfde2a4 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:58.822087 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-1f89efa9-209b-4faa-9455-15335bfde2a4 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:58.828783 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1f89efa9-209b-4faa-9455-15335bfde2a4 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:58.829464 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1f89efa9-209b-4faa-9455-15335bfde2a4 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:58.830223 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1f89efa9-209b-4faa-9455-15335bfde2a4 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:58.830651 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1f89efa9-209b-4faa-9455-15335bfde2a4 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:58.833181 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-5c6d3d04-d40d-4bbe-9585-b5727b03b3be tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:58.833982 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-5c6d3d04-d40d-4bbe-9585-b5727b03b3be tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 514a7771-fbf2-46db-9e3d-905a6a3e703d] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:58.849344 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-5c6d3d04-d40d-4bbe-9585-b5727b03b3be tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:58.849344 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-5c6d3d04-d40d-4bbe-9585-b5727b03b3be tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:58.849344 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-5c6d3d04-d40d-4bbe-9585-b5727b03b3be tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:58.849344 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-5c6d3d04-d40d-4bbe-9585-b5727b03b3be tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:59.008593 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-1f89efa9-209b-4faa-9455-15335bfde2a4 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:59.016915 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-1f89efa9-209b-4faa-9455-15335bfde2a4 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a" status: 200 len: 1362 microversion: 2.1 time: 0.199175 Jul 21 20:05:59.021212 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 128/238] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:58 2022] GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a => generated 1362 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:05:59.030767 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-5c6d3d04-d40d-4bbe-9585-b5727b03b3be tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:59.038985 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-5c6d3d04-d40d-4bbe-9585-b5727b03b3be tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d" status: 200 len: 1321 microversion: 2.1 time: 0.211321 Jul 21 20:05:59.039606 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 111/239] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:58 2022] GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d => generated 1321 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:05:59.137525 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-ba51ac19-284d-43a5-82c3-683ed40cd84b tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:59.138369 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-ba51ac19-284d-43a5-82c3-683ed40cd84b tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:59.144520 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ba51ac19-284d-43a5-82c3-683ed40cd84b tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:59.145539 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ba51ac19-284d-43a5-82c3-683ed40cd84b tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:59.146314 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ba51ac19-284d-43a5-82c3-683ed40cd84b tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:59.146748 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ba51ac19-284d-43a5-82c3-683ed40cd84b tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:59.280855 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-ba51ac19-284d-43a5-82c3-683ed40cd84b tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:59.290361 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-ba51ac19-284d-43a5-82c3-683ed40cd84b tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:59.291963 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-ba51ac19-284d-43a5-82c3-683ed40cd84b tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:05:59.293069 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-ba51ac19-284d-43a5-82c3-683ed40cd84b tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1406 microversion: 2.20 time: 0.159401 Jul 21 20:05:59.293643 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 129/240] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:05:59 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:05:59.637183 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [req-4a367db4-fac9-4ee5-bfa9-02893be713e6 req-d7c1627b-58f0-47dd-8a08-45c26b735699 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b07e385b-3d8f-4370-a8fc-013a1c785c0f", "name": "network-vif-plugged", "status": "completed", "tag": "b6f7db3f-a2e0-4b71-a01c-2b805c7bf070"}]} {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:05:59.645979 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [req-4a367db4-fac9-4ee5-bfa9-02893be713e6 req-d7c1627b-58f0-47dd-8a08-45c26b735699 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:59.646424 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [req-4a367db4-fac9-4ee5-bfa9-02893be713e6 req-d7c1627b-58f0-47dd-8a08-45c26b735699 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:59.657962 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.compute.server_external_events [req-4a367db4-fac9-4ee5-bfa9-02893be713e6 req-d7c1627b-58f0-47dd-8a08-45c26b735699 service nova] Creating event network-vif-plugged:b6f7db3f-a2e0-4b71-a01c-2b805c7bf070 for instance b07e385b-3d8f-4370-a8fc-013a1c785c0f on hv-cinder-85054 Jul 21 20:05:59.662967 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [req-4a367db4-fac9-4ee5-bfa9-02893be713e6 req-d7c1627b-58f0-47dd-8a08-45c26b735699 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029526 Jul 21 20:05:59.663575 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 112/241] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 20:05:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:05:59.828943 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-e86ab76b-0cce-406d-9fba-368d40808abe tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:05:59.829834 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-e86ab76b-0cce-406d-9fba-368d40808abe tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 8f00566b-862b-4171-9259-b12aaa7ea030] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:05:59.837175 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e86ab76b-0cce-406d-9fba-368d40808abe tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:59.837359 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e86ab76b-0cce-406d-9fba-368d40808abe tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:59.838288 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e86ab76b-0cce-406d-9fba-368d40808abe tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:05:59.838826 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e86ab76b-0cce-406d-9fba-368d40808abe tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:05:59.999769 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-e86ab76b-0cce-406d-9fba-368d40808abe tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:06:00.012843 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-e86ab76b-0cce-406d-9fba-368d40808abe tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030" status: 200 len: 1556 microversion: 2.1 time: 0.188223 Jul 21 20:06:00.013610 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 130/242] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:05:59 2022] GET /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030 => generated 1556 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:06:00.037969 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-4799d64a-4c28-4100-8dc2-2413b6728421 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:06:00.038975 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-4799d64a-4c28-4100-8dc2-2413b6728421 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 8f00566b-862b-4171-9259-b12aaa7ea030] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:06:00.040060 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-72379dd0-66cb-4da5-ace7-62f364791fef tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:06:00.040673 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-72379dd0-66cb-4da5-ace7-62f364791fef tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:06:00.052764 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-72379dd0-66cb-4da5-ace7-62f364791fef tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:00.053416 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-72379dd0-66cb-4da5-ace7-62f364791fef tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:00.054352 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-72379dd0-66cb-4da5-ace7-62f364791fef tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:00.055063 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-72379dd0-66cb-4da5-ace7-62f364791fef tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:00.056242 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-4799d64a-4c28-4100-8dc2-2413b6728421 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:00.059210 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-4799d64a-4c28-4100-8dc2-2413b6728421 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:00.060882 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-4799d64a-4c28-4100-8dc2-2413b6728421 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:00.061521 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-4799d64a-4c28-4100-8dc2-2413b6728421 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:00.228226 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-4799d64a-4c28-4100-8dc2-2413b6728421 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.198886 Jul 21 20:06:00.228826 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 113/243] 10.222.0.58 () {58 vars in 1274 bytes} [Thu Jul 21 20:06:00 2022] GET /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030/os-interface => generated 284 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:06:00.240223 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-357f67f6-43a2-48ff-8bcb-c25f19042981 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:06:00.240903 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-357f67f6-43a2-48ff-8bcb-c25f19042981 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 514a7771-fbf2-46db-9e3d-905a6a3e703d] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:06:00.247278 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-357f67f6-43a2-48ff-8bcb-c25f19042981 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:00.257560 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-357f67f6-43a2-48ff-8bcb-c25f19042981 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:00.258719 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-357f67f6-43a2-48ff-8bcb-c25f19042981 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:00.259094 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-357f67f6-43a2-48ff-8bcb-c25f19042981 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:00.359691 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-72379dd0-66cb-4da5-ace7-62f364791fef tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:06:00.379109 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-72379dd0-66cb-4da5-ace7-62f364791fef tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a" status: 200 len: 1362 microversion: 2.1 time: 0.340924 Jul 21 20:06:00.382904 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 131/244] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:06:00 2022] GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a => generated 1362 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:06:00.390471 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-2ee08c87-7099-4be9-99f1-14acff807ea6 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:06:00.391444 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-2ee08c87-7099-4be9-99f1-14acff807ea6 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:06:00.398903 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2ee08c87-7099-4be9-99f1-14acff807ea6 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:00.399784 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2ee08c87-7099-4be9-99f1-14acff807ea6 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:00.400769 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2ee08c87-7099-4be9-99f1-14acff807ea6 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:00.401388 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2ee08c87-7099-4be9-99f1-14acff807ea6 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:00.423635 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-357f67f6-43a2-48ff-8bcb-c25f19042981 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:06:00.432855 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-357f67f6-43a2-48ff-8bcb-c25f19042981 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d" status: 200 len: 1515 microversion: 2.1 time: 0.196933 Jul 21 20:06:00.433432 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 114/245] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:06:00 2022] GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d => generated 1515 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:06:00.455087 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-40ac8d4c-9a4f-4a56-8416-276da0f74286 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:06:00.456059 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-40ac8d4c-9a4f-4a56-8416-276da0f74286 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 514a7771-fbf2-46db-9e3d-905a6a3e703d] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:06:00.465362 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-40ac8d4c-9a4f-4a56-8416-276da0f74286 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:00.465817 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-40ac8d4c-9a4f-4a56-8416-276da0f74286 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:00.466862 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-40ac8d4c-9a4f-4a56-8416-276da0f74286 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:00.467328 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-40ac8d4c-9a4f-4a56-8416-276da0f74286 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:00.491221 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.objects.instance [None req-40ac8d4c-9a4f-4a56-8416-276da0f74286 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lazy-loading 'flavor' on Instance uuid 514a7771-fbf2-46db-9e3d-905a6a3e703d {{(pid=118344) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 20:06:00.662437 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-2ee08c87-7099-4be9-99f1-14acff807ea6 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:06:00.670391 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-2ee08c87-7099-4be9-99f1-14acff807ea6 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:06:00.671980 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-2ee08c87-7099-4be9-99f1-14acff807ea6 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:06:00.673125 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-2ee08c87-7099-4be9-99f1-14acff807ea6 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1406 microversion: 2.20 time: 0.287794 Jul 21 20:06:00.673676 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 132/246] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:06:00 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1406 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:06:00.868878 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-40ac8d4c-9a4f-4a56-8416-276da0f74286 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "POST /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d/action" status: 200 len: 32 microversion: 2.1 time: 0.417760 Jul 21 20:06:00.873286 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 115/247] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Jul 21 20:06:00 2022] POST /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d/action => generated 32 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 21 20:06:00.882270 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-089fdd55-d50f-44c9-b6ab-1f2082648701 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:06:00.882270 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-089fdd55-d50f-44c9-b6ab-1f2082648701 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 514a7771-fbf2-46db-9e3d-905a6a3e703d] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:06:00.889833 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-089fdd55-d50f-44c9-b6ab-1f2082648701 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:00.890297 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-089fdd55-d50f-44c9-b6ab-1f2082648701 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:00.891105 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-089fdd55-d50f-44c9-b6ab-1f2082648701 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:00.891549 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-089fdd55-d50f-44c9-b6ab-1f2082648701 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:01.014722 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-1060444a-f031-4afe-bf02-c732a58948bc tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "72c03b1e-ab29-4178-8bc4-e3b684850c82"}} {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:06:01.016457 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-1060444a-f031-4afe-bf02-c732a58948bc tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] [instance: 3c7c536b-2058-4226-938c-65ec0ad3dddc] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:06:01.023864 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-1060444a-f031-4afe-bf02-c732a58948bc tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:01.024376 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-1060444a-f031-4afe-bf02-c732a58948bc tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:01.025155 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-1060444a-f031-4afe-bf02-c732a58948bc tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:01.025592 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-1060444a-f031-4afe-bf02-c732a58948bc tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:01.170463 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-089fdd55-d50f-44c9-b6ab-1f2082648701 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:06:01.182704 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-089fdd55-d50f-44c9-b6ab-1f2082648701 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d" status: 200 len: 1521 microversion: 2.1 time: 0.307066 Jul 21 20:06:01.187412 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 133/248] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:06:00 2022] GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d => generated 1521 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:06:01.400345 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-af269bb6-bdd5-4f3f-a754-408ba0cf1203 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:06:01.400873 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-af269bb6-bdd5-4f3f-a754-408ba0cf1203 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:06:01.406931 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-af269bb6-bdd5-4f3f-a754-408ba0cf1203 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:01.407409 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-af269bb6-bdd5-4f3f-a754-408ba0cf1203 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:01.410261 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-af269bb6-bdd5-4f3f-a754-408ba0cf1203 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:01.410261 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-af269bb6-bdd5-4f3f-a754-408ba0cf1203 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:01.910784 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-af269bb6-bdd5-4f3f-a754-408ba0cf1203 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:06:01.923586 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-af269bb6-bdd5-4f3f-a754-408ba0cf1203 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a" status: 200 len: 1362 microversion: 2.1 time: 0.527268 Jul 21 20:06:01.926436 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 134/249] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:06:01 2022] GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a => generated 1362 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:06:01.931477 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [req-64cc6ea3-5aa1-423a-a5e2-5885b2cf26a4 req-112a70bb-87f2-4fe1-8df1-d14d8904f7c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a", "name": "network-vif-plugged", "status": "completed", "tag": "4ee28e4e-c490-4447-b3bb-8dbba6042538"}]} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:06:01.939523 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-64cc6ea3-5aa1-423a-a5e2-5885b2cf26a4 req-112a70bb-87f2-4fe1-8df1-d14d8904f7c4 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:01.939954 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-64cc6ea3-5aa1-423a-a5e2-5885b2cf26a4 req-112a70bb-87f2-4fe1-8df1-d14d8904f7c4 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:01.952405 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.compute.server_external_events [req-64cc6ea3-5aa1-423a-a5e2-5885b2cf26a4 req-112a70bb-87f2-4fe1-8df1-d14d8904f7c4 service nova] Creating event network-vif-plugged:4ee28e4e-c490-4447-b3bb-8dbba6042538 for instance 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a on hv-cinder-85054 Jul 21 20:06:01.957539 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [req-64cc6ea3-5aa1-423a-a5e2-5885b2cf26a4 req-112a70bb-87f2-4fe1-8df1-d14d8904f7c4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029955 Jul 21 20:06:01.958949 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 135/250] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 20:06:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:06:01.968045 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-1eaad6d0-8c69-4b9f-8cc3-df9338c73359 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:06:01.968806 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-1eaad6d0-8c69-4b9f-8cc3-df9338c73359 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:06:01.975348 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1eaad6d0-8c69-4b9f-8cc3-df9338c73359 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:01.976842 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1eaad6d0-8c69-4b9f-8cc3-df9338c73359 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:01.976842 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1eaad6d0-8c69-4b9f-8cc3-df9338c73359 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:01.977052 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1eaad6d0-8c69-4b9f-8cc3-df9338c73359 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:02.206869 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-1eaad6d0-8c69-4b9f-8cc3-df9338c73359 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:06:02.217967 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-1eaad6d0-8c69-4b9f-8cc3-df9338c73359 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:06:02.220014 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-1eaad6d0-8c69-4b9f-8cc3-df9338c73359 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:06:02.221157 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-1eaad6d0-8c69-4b9f-8cc3-df9338c73359 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1406 microversion: 2.20 time: 0.258282 Jul 21 20:06:02.222111 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 136/251] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:06:01 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1406 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:06:02.227828 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-912aadb6-2148-4f22-be7c-8b291eba0cc5 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:06:02.228334 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-912aadb6-2148-4f22-be7c-8b291eba0cc5 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 514a7771-fbf2-46db-9e3d-905a6a3e703d] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:06:02.241631 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-912aadb6-2148-4f22-be7c-8b291eba0cc5 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:02.242083 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-912aadb6-2148-4f22-be7c-8b291eba0cc5 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:02.243155 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-912aadb6-2148-4f22-be7c-8b291eba0cc5 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:02.243554 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-912aadb6-2148-4f22-be7c-8b291eba0cc5 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:02.532711 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-912aadb6-2148-4f22-be7c-8b291eba0cc5 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:06:02.540378 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-912aadb6-2148-4f22-be7c-8b291eba0cc5 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d" status: 200 len: 1521 microversion: 2.1 time: 0.317281 Jul 21 20:06:02.551100 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 137/252] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:06:02 2022] GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d => generated 1521 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:06:02.551100 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [req-12e90f8a-eb83-4302-b40b-94f64d5fe67d req-ed6299c7-86b8-4c93-b553-77515a9bd182 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f00566b-862b-4171-9259-b12aaa7ea030", "tag": "41ea78c8-2eb5-49db-9ee7-8b020833e0f8"}]} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:06:02.559387 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-12e90f8a-eb83-4302-b40b-94f64d5fe67d req-ed6299c7-86b8-4c93-b553-77515a9bd182 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:02.559969 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-12e90f8a-eb83-4302-b40b-94f64d5fe67d req-ed6299c7-86b8-4c93-b553-77515a9bd182 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:02.573323 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.compute.server_external_events [req-12e90f8a-eb83-4302-b40b-94f64d5fe67d req-ed6299c7-86b8-4c93-b553-77515a9bd182 service nova] Creating event network-changed:41ea78c8-2eb5-49db-9ee7-8b020833e0f8 for instance 8f00566b-862b-4171-9259-b12aaa7ea030 on hv-cinder-85054 Jul 21 20:06:02.578688 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [req-12e90f8a-eb83-4302-b40b-94f64d5fe67d req-ed6299c7-86b8-4c93-b553-77515a9bd182 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032343 Jul 21 20:06:02.579668 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 138/253] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 20:06:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:06:02.944130 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-23f3ac7c-6b49-4ec2-bcd9-4464b703b6bf tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:06:02.944916 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-23f3ac7c-6b49-4ec2-bcd9-4464b703b6bf tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:06:02.951324 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-23f3ac7c-6b49-4ec2-bcd9-4464b703b6bf tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:02.951824 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-23f3ac7c-6b49-4ec2-bcd9-4464b703b6bf tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:02.952700 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-23f3ac7c-6b49-4ec2-bcd9-4464b703b6bf tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:02.953257 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-23f3ac7c-6b49-4ec2-bcd9-4464b703b6bf tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:03.099383 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-23f3ac7c-6b49-4ec2-bcd9-4464b703b6bf tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:06:03.107530 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-23f3ac7c-6b49-4ec2-bcd9-4464b703b6bf tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a" status: 200 len: 1362 microversion: 2.1 time: 0.168288 Jul 21 20:06:03.118704 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 139/254] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:06:02 2022] GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a => generated 1362 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:06:03.240320 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-0970fa45-52d2-44fc-8f35-af09af780606 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:06:03.241001 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-0970fa45-52d2-44fc-8f35-af09af780606 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:06:03.247484 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0970fa45-52d2-44fc-8f35-af09af780606 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:03.247932 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0970fa45-52d2-44fc-8f35-af09af780606 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:03.248999 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0970fa45-52d2-44fc-8f35-af09af780606 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:03.249142 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0970fa45-52d2-44fc-8f35-af09af780606 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:03.374497 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-1060444a-f031-4afe-bf02-c732a58948bc tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] 10.222.0.58 "POST /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.365308 Jul 21 20:06:03.375623 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 116/255] 10.222.0.58 () {60 vars in 1322 bytes} [Thu Jul 21 20:06:01 2022] POST /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc/os-volume_attachments => generated 194 bytes in 2367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:06:03.414742 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-0970fa45-52d2-44fc-8f35-af09af780606 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:06:03.422918 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-0970fa45-52d2-44fc-8f35-af09af780606 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:06:03.424461 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-0970fa45-52d2-44fc-8f35-af09af780606 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:06:03.425579 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-0970fa45-52d2-44fc-8f35-af09af780606 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1406 microversion: 2.20 time: 0.189934 Jul 21 20:06:03.426188 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 140/256] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:06:03 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1406 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 20:06:03.557712 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-24ae93ff-89ea-442c-8030-fb0ca80e52ca tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:06:03.558346 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-24ae93ff-89ea-442c-8030-fb0ca80e52ca tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 514a7771-fbf2-46db-9e3d-905a6a3e703d] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:06:03.564697 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-24ae93ff-89ea-442c-8030-fb0ca80e52ca tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:03.565138 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-24ae93ff-89ea-442c-8030-fb0ca80e52ca tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:03.565900 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-24ae93ff-89ea-442c-8030-fb0ca80e52ca tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:03.566356 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-24ae93ff-89ea-442c-8030-fb0ca80e52ca tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:03.753491 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-24ae93ff-89ea-442c-8030-fb0ca80e52ca tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:06:03.762872 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-24ae93ff-89ea-442c-8030-fb0ca80e52ca tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d" status: 200 len: 1521 microversion: 2.1 time: 0.209421 Jul 21 20:06:03.764369 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 117/257] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:06:03 2022] GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d => generated 1521 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:06:04.124489 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-7414def0-704e-43ca-8375-09a6a3752d74 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:06:04.125092 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-7414def0-704e-43ca-8375-09a6a3752d74 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:06:04.132017 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-7414def0-704e-43ca-8375-09a6a3752d74 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:04.132592 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-7414def0-704e-43ca-8375-09a6a3752d74 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:04.133534 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-7414def0-704e-43ca-8375-09a6a3752d74 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:04.134029 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-7414def0-704e-43ca-8375-09a6a3752d74 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:04.281233 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-7414def0-704e-43ca-8375-09a6a3752d74 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:06:04.286968 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-7414def0-704e-43ca-8375-09a6a3752d74 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a" status: 200 len: 1362 microversion: 2.1 time: 0.166372 Jul 21 20:06:04.287698 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 141/258] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:06:04 2022] GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:06:04.444294 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-212e1ea1-2035-4480-92cb-108ce17b6e90 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:06:04.444901 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-212e1ea1-2035-4480-92cb-108ce17b6e90 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:06:04.454146 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-212e1ea1-2035-4480-92cb-108ce17b6e90 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:04.454601 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-212e1ea1-2035-4480-92cb-108ce17b6e90 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:04.455707 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-212e1ea1-2035-4480-92cb-108ce17b6e90 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:04.456133 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-212e1ea1-2035-4480-92cb-108ce17b6e90 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:04.607455 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-212e1ea1-2035-4480-92cb-108ce17b6e90 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:06:04.616522 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-212e1ea1-2035-4480-92cb-108ce17b6e90 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:06:04.623569 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-212e1ea1-2035-4480-92cb-108ce17b6e90 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:06:04.623569 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-212e1ea1-2035-4480-92cb-108ce17b6e90 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1406 microversion: 2.20 time: 0.179492 Jul 21 20:06:04.623569 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 118/259] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:06:04 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1406 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:06:04.780860 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-e81e932a-ef4c-415b-8638-d96942b21667 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:06:04.781459 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-e81e932a-ef4c-415b-8638-d96942b21667 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 514a7771-fbf2-46db-9e3d-905a6a3e703d] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:06:04.787511 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e81e932a-ef4c-415b-8638-d96942b21667 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:04.787953 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e81e932a-ef4c-415b-8638-d96942b21667 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:04.788707 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e81e932a-ef4c-415b-8638-d96942b21667 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:04.789141 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e81e932a-ef4c-415b-8638-d96942b21667 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:05.042494 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-e81e932a-ef4c-415b-8638-d96942b21667 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:06:05.046149 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell1:SELECT=100 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:06:05.050428 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-e81e932a-ef4c-415b-8638-d96942b21667 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d" status: 200 len: 1521 microversion: 2.1 time: 0.273849 Jul 21 20:06:05.051518 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 142/260] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:06:04 2022] GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d => generated 1521 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:06:05.305291 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-f2118aa8-6869-432c-98bf-b23a04155adc tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:06:05.305899 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-f2118aa8-6869-432c-98bf-b23a04155adc tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:06:05.312186 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f2118aa8-6869-432c-98bf-b23a04155adc tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:05.312631 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f2118aa8-6869-432c-98bf-b23a04155adc tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:05.313437 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f2118aa8-6869-432c-98bf-b23a04155adc tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:05.313833 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f2118aa8-6869-432c-98bf-b23a04155adc tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:05.471659 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-f2118aa8-6869-432c-98bf-b23a04155adc tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:06:05.477105 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG dbcounter [-] [118344] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:06:05.482385 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-f2118aa8-6869-432c-98bf-b23a04155adc tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a" status: 200 len: 1362 microversion: 2.1 time: 0.181463 Jul 21 20:06:05.482967 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 119/261] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:06:05 2022] GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a => generated 1362 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:06:05.638447 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-3a8ed16a-f3f7-4b74-9651-c38d11a62160 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:06:05.639089 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-3a8ed16a-f3f7-4b74-9651-c38d11a62160 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:06:05.645781 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3a8ed16a-f3f7-4b74-9651-c38d11a62160 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:05.646222 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3a8ed16a-f3f7-4b74-9651-c38d11a62160 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:05.647298 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3a8ed16a-f3f7-4b74-9651-c38d11a62160 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:05.647419 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3a8ed16a-f3f7-4b74-9651-c38d11a62160 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:05.782299 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-3a8ed16a-f3f7-4b74-9651-c38d11a62160 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:06:05.791417 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-3a8ed16a-f3f7-4b74-9651-c38d11a62160 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:06:05.793072 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-3a8ed16a-f3f7-4b74-9651-c38d11a62160 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:06:05.796618 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-3a8ed16a-f3f7-4b74-9651-c38d11a62160 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1597 microversion: 2.20 time: 0.159732 Jul 21 20:06:05.796618 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 143/262] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:06:05 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1597 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:06:05.814198 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-087b635d-16d1-4990-879d-29729ed3501a tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:06:05.814761 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-087b635d-16d1-4990-879d-29729ed3501a tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:06:05.822231 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-087b635d-16d1-4990-879d-29729ed3501a tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:05.822751 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-087b635d-16d1-4990-879d-29729ed3501a tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:05.823615 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-087b635d-16d1-4990-879d-29729ed3501a tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:05.824162 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-087b635d-16d1-4990-879d-29729ed3501a tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:05.903732 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-087b635d-16d1-4990-879d-29729ed3501a tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.093386 Jul 21 20:06:05.906971 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 120/263] 10.222.0.58 () {60 vars in 1315 bytes} [Thu Jul 21 20:06:05 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 20:06:06.068011 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-f008ebb3-7656-483b-9292-9d835625b364 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:06:06.069197 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-f008ebb3-7656-483b-9292-9d835625b364 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 514a7771-fbf2-46db-9e3d-905a6a3e703d] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:06:06.077298 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f008ebb3-7656-483b-9292-9d835625b364 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:06.077867 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f008ebb3-7656-483b-9292-9d835625b364 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:06.079060 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f008ebb3-7656-483b-9292-9d835625b364 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:06.079822 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f008ebb3-7656-483b-9292-9d835625b364 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:06.421508 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-f008ebb3-7656-483b-9292-9d835625b364 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:06:06.429923 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-f008ebb3-7656-483b-9292-9d835625b364 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d" status: 200 len: 1521 microversion: 2.1 time: 0.365675 Jul 21 20:06:06.431008 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 144/264] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:06:06 2022] GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d => generated 1521 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:06:06.502207 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-87d81934-6296-423b-9615-eb87592f62fd tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:06:06.503484 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-87d81934-6296-423b-9615-eb87592f62fd tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:06:06.511099 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-87d81934-6296-423b-9615-eb87592f62fd tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:06.511541 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-87d81934-6296-423b-9615-eb87592f62fd tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:06.512332 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-87d81934-6296-423b-9615-eb87592f62fd tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:06.512758 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-87d81934-6296-423b-9615-eb87592f62fd tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:06.815245 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-87d81934-6296-423b-9615-eb87592f62fd tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:06:06.822677 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-87d81934-6296-423b-9615-eb87592f62fd tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a" status: 200 len: 1362 microversion: 2.1 time: 0.325700 Jul 21 20:06:06.823275 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 121/265] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:06:06 2022] GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a => generated 1362 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:06:07.427875 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [req-e04a3beb-66c7-4a21-aed9-cc7b4534987e req-85be0eea-a77d-4aec-a2a9-949439b892e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b07e385b-3d8f-4370-a8fc-013a1c785c0f", "tag": "b6f7db3f-a2e0-4b71-a01c-2b805c7bf070"}]} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:06:07.445497 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-e04a3beb-66c7-4a21-aed9-cc7b4534987e req-85be0eea-a77d-4aec-a2a9-949439b892e6 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:07.446040 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-e04a3beb-66c7-4a21-aed9-cc7b4534987e req-85be0eea-a77d-4aec-a2a9-949439b892e6 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:07.447687 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-20458224-11e9-4697-90e3-591379f6fea8 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:06:07.448503 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-20458224-11e9-4697-90e3-591379f6fea8 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 514a7771-fbf2-46db-9e3d-905a6a3e703d] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:06:07.455451 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-20458224-11e9-4697-90e3-591379f6fea8 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:07.455904 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-20458224-11e9-4697-90e3-591379f6fea8 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:07.457784 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-20458224-11e9-4697-90e3-591379f6fea8 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:07.458474 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-20458224-11e9-4697-90e3-591379f6fea8 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:07.458976 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.compute.server_external_events [req-e04a3beb-66c7-4a21-aed9-cc7b4534987e req-85be0eea-a77d-4aec-a2a9-949439b892e6 service nova] Creating event network-changed:b6f7db3f-a2e0-4b71-a01c-2b805c7bf070 for instance b07e385b-3d8f-4370-a8fc-013a1c785c0f on hv-cinder-85054 Jul 21 20:06:07.465640 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [req-e04a3beb-66c7-4a21-aed9-cc7b4534987e req-85be0eea-a77d-4aec-a2a9-949439b892e6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045486 Jul 21 20:06:07.474711 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 145/266] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 20:06:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:06:07.637524 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-20458224-11e9-4697-90e3-591379f6fea8 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:06:07.650668 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-20458224-11e9-4697-90e3-591379f6fea8 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d" status: 200 len: 1521 microversion: 2.1 time: 0.207201 Jul 21 20:06:07.660611 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 122/267] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:06:07 2022] GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d => generated 1521 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:06:07.841395 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-92e5c947-e288-4060-9acf-4521ebdece4a tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:06:07.842521 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-92e5c947-e288-4060-9acf-4521ebdece4a tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:06:07.850305 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-92e5c947-e288-4060-9acf-4521ebdece4a tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:07.850908 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-92e5c947-e288-4060-9acf-4521ebdece4a tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:07.851788 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-92e5c947-e288-4060-9acf-4521ebdece4a tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:07.852293 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-92e5c947-e288-4060-9acf-4521ebdece4a tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:08.027969 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-92e5c947-e288-4060-9acf-4521ebdece4a tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:06:08.036851 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-92e5c947-e288-4060-9acf-4521ebdece4a tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a" status: 200 len: 1548 microversion: 2.1 time: 0.199424 Jul 21 20:06:08.036851 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 146/268] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:06:07 2022] GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a => generated 1548 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:06:08.053746 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-f77724b7-b2d6-4f6f-9492-b2c18bb19a04 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:06:08.054756 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-f77724b7-b2d6-4f6f-9492-b2c18bb19a04 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:06:08.062104 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f77724b7-b2d6-4f6f-9492-b2c18bb19a04 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:08.062814 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f77724b7-b2d6-4f6f-9492-b2c18bb19a04 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:08.064062 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f77724b7-b2d6-4f6f-9492-b2c18bb19a04 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:08.064632 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f77724b7-b2d6-4f6f-9492-b2c18bb19a04 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:08.160166 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-f77724b7-b2d6-4f6f-9492-b2c18bb19a04 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.111224 Jul 21 20:06:08.160900 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 123/269] 10.222.0.58 () {58 vars in 1274 bytes} [Thu Jul 21 20:06:08 2022] GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a/os-interface => generated 285 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:06:08.669664 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-bc8e3847-6092-470e-929b-8d5d02947a3b tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:06:08.671081 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-bc8e3847-6092-470e-929b-8d5d02947a3b tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 514a7771-fbf2-46db-9e3d-905a6a3e703d] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:06:08.679001 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-bc8e3847-6092-470e-929b-8d5d02947a3b tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:08.679498 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-bc8e3847-6092-470e-929b-8d5d02947a3b tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:08.680514 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-bc8e3847-6092-470e-929b-8d5d02947a3b tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:08.681121 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-bc8e3847-6092-470e-929b-8d5d02947a3b tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:09.211334 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-bc8e3847-6092-470e-929b-8d5d02947a3b tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:06:09.219253 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-bc8e3847-6092-470e-929b-8d5d02947a3b tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d" status: 200 len: 1521 microversion: 2.1 time: 0.554387 Jul 21 20:06:09.220047 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 147/270] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:06:08 2022] GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d => generated 1521 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:06:09.824255 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [req-6b7bab9c-ecce-4bae-9de2-822633c6aac2 req-510217ea-e828-475c-818b-4c9e6636c75e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a", "tag": "4ee28e4e-c490-4447-b3bb-8dbba6042538"}]} {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:06:09.847701 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [req-6b7bab9c-ecce-4bae-9de2-822633c6aac2 req-510217ea-e828-475c-818b-4c9e6636c75e service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:09.848132 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [req-6b7bab9c-ecce-4bae-9de2-822633c6aac2 req-510217ea-e828-475c-818b-4c9e6636c75e service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:09.862381 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.compute.server_external_events [req-6b7bab9c-ecce-4bae-9de2-822633c6aac2 req-510217ea-e828-475c-818b-4c9e6636c75e service nova] Creating event network-changed:4ee28e4e-c490-4447-b3bb-8dbba6042538 for instance 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a on hv-cinder-85054 Jul 21 20:06:09.867831 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [req-6b7bab9c-ecce-4bae-9de2-822633c6aac2 req-510217ea-e828-475c-818b-4c9e6636c75e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047819 Jul 21 20:06:09.868986 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 124/271] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 20:06:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:06:10.240100 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-c8711dce-e8bc-462f-9fd7-21b58f721bdc tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:06:10.240700 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-c8711dce-e8bc-462f-9fd7-21b58f721bdc tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 514a7771-fbf2-46db-9e3d-905a6a3e703d] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:06:10.279620 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c8711dce-e8bc-462f-9fd7-21b58f721bdc tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:10.280202 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c8711dce-e8bc-462f-9fd7-21b58f721bdc tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:10.281243 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c8711dce-e8bc-462f-9fd7-21b58f721bdc tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:10.283399 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c8711dce-e8bc-462f-9fd7-21b58f721bdc tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:10.509549 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-c8711dce-e8bc-462f-9fd7-21b58f721bdc tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:06:10.517687 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-c8711dce-e8bc-462f-9fd7-21b58f721bdc tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d" status: 200 len: 1521 microversion: 2.1 time: 0.285199 Jul 21 20:06:10.527523 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 148/272] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:06:10 2022] GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d => generated 1521 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:06:11.535508 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-906d7e30-3cb7-47f8-9dc8-4d4111f1a004 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:06:11.536203 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-906d7e30-3cb7-47f8-9dc8-4d4111f1a004 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 514a7771-fbf2-46db-9e3d-905a6a3e703d] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:06:11.542333 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-906d7e30-3cb7-47f8-9dc8-4d4111f1a004 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:11.542806 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-906d7e30-3cb7-47f8-9dc8-4d4111f1a004 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:11.543598 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-906d7e30-3cb7-47f8-9dc8-4d4111f1a004 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:11.544031 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-906d7e30-3cb7-47f8-9dc8-4d4111f1a004 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:11.681903 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-906d7e30-3cb7-47f8-9dc8-4d4111f1a004 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:06:11.689417 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-906d7e30-3cb7-47f8-9dc8-4d4111f1a004 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d" status: 200 len: 1521 microversion: 2.1 time: 0.158682 Jul 21 20:06:11.689987 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 125/273] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:06:11 2022] GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:06:12.706276 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-1e65289b-b36a-46c0-b906-5d159c53c643 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:06:12.706894 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-1e65289b-b36a-46c0-b906-5d159c53c643 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 514a7771-fbf2-46db-9e3d-905a6a3e703d] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:06:12.713039 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1e65289b-b36a-46c0-b906-5d159c53c643 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:12.713433 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1e65289b-b36a-46c0-b906-5d159c53c643 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:12.714204 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1e65289b-b36a-46c0-b906-5d159c53c643 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:12.714639 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1e65289b-b36a-46c0-b906-5d159c53c643 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:12.846359 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-1e65289b-b36a-46c0-b906-5d159c53c643 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:06:12.854222 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-1e65289b-b36a-46c0-b906-5d159c53c643 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d" status: 200 len: 1521 microversion: 2.1 time: 0.151819 Jul 21 20:06:12.854784 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 149/274] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:06:12 2022] GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:06:13.871728 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-7fa3e0c9-c2d0-4f54-94f0-5dd296456490 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:06:13.872339 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-7fa3e0c9-c2d0-4f54-94f0-5dd296456490 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 514a7771-fbf2-46db-9e3d-905a6a3e703d] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:06:13.874979 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG dbcounter [-] [118344] Writing DB stats nova_api:SELECT=95 {{(pid=118344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:06:13.879746 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-7fa3e0c9-c2d0-4f54-94f0-5dd296456490 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:13.880210 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-7fa3e0c9-c2d0-4f54-94f0-5dd296456490 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:13.881066 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-7fa3e0c9-c2d0-4f54-94f0-5dd296456490 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:13.881631 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-7fa3e0c9-c2d0-4f54-94f0-5dd296456490 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:14.010766 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-7fa3e0c9-c2d0-4f54-94f0-5dd296456490 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:06:14.018789 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-7fa3e0c9-c2d0-4f54-94f0-5dd296456490 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d" status: 200 len: 1521 microversion: 2.1 time: 0.150790 Jul 21 20:06:14.020371 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 126/275] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:06:13 2022] GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:06:15.036474 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-99ac6dd2-8e4a-4052-ad14-96e992039e46 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:06:15.037121 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-99ac6dd2-8e4a-4052-ad14-96e992039e46 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 514a7771-fbf2-46db-9e3d-905a6a3e703d] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:06:15.044239 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-99ac6dd2-8e4a-4052-ad14-96e992039e46 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:15.044709 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-99ac6dd2-8e4a-4052-ad14-96e992039e46 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:15.045491 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-99ac6dd2-8e4a-4052-ad14-96e992039e46 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:15.045926 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-99ac6dd2-8e4a-4052-ad14-96e992039e46 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:15.174130 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-99ac6dd2-8e4a-4052-ad14-96e992039e46 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:06:15.179968 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-99ac6dd2-8e4a-4052-ad14-96e992039e46 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d" status: 200 len: 1521 microversion: 2.1 time: 0.147604 Jul 21 20:06:15.180519 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 150/276] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:06:15 2022] GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:06:16.197225 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-0acaa853-b772-4a3f-a8a2-152eafc82b64 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:06:16.199307 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-0acaa853-b772-4a3f-a8a2-152eafc82b64 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 514a7771-fbf2-46db-9e3d-905a6a3e703d] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:06:16.204103 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-0acaa853-b772-4a3f-a8a2-152eafc82b64 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:16.204559 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-0acaa853-b772-4a3f-a8a2-152eafc82b64 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:16.205314 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-0acaa853-b772-4a3f-a8a2-152eafc82b64 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:16.209682 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-0acaa853-b772-4a3f-a8a2-152eafc82b64 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:16.334786 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-0acaa853-b772-4a3f-a8a2-152eafc82b64 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:06:16.342970 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-0acaa853-b772-4a3f-a8a2-152eafc82b64 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d" status: 200 len: 1521 microversion: 2.1 time: 0.149604 Jul 21 20:06:16.343577 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 127/277] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:06:16 2022] GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:06:17.360007 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-75a3428a-787e-4d0d-86b4-317464b9f9f8 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:06:17.360614 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-75a3428a-787e-4d0d-86b4-317464b9f9f8 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 514a7771-fbf2-46db-9e3d-905a6a3e703d] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:06:17.367328 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-75a3428a-787e-4d0d-86b4-317464b9f9f8 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:17.367774 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-75a3428a-787e-4d0d-86b4-317464b9f9f8 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:17.368533 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-75a3428a-787e-4d0d-86b4-317464b9f9f8 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:17.368965 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-75a3428a-787e-4d0d-86b4-317464b9f9f8 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:17.513104 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-75a3428a-787e-4d0d-86b4-317464b9f9f8 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:06:17.520551 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-75a3428a-787e-4d0d-86b4-317464b9f9f8 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d" status: 200 len: 1521 microversion: 2.1 time: 0.164427 Jul 21 20:06:17.521110 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 151/278] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:06:17 2022] GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:06:18.538066 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-6fc94454-49f2-4e0d-9db2-184a18781eb7 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:06:18.538609 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-6fc94454-49f2-4e0d-9db2-184a18781eb7 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 514a7771-fbf2-46db-9e3d-905a6a3e703d] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:06:18.545146 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-6fc94454-49f2-4e0d-9db2-184a18781eb7 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:18.545591 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-6fc94454-49f2-4e0d-9db2-184a18781eb7 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:18.546351 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-6fc94454-49f2-4e0d-9db2-184a18781eb7 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:18.546783 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-6fc94454-49f2-4e0d-9db2-184a18781eb7 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:18.682837 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-6fc94454-49f2-4e0d-9db2-184a18781eb7 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:06:18.690289 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-6fc94454-49f2-4e0d-9db2-184a18781eb7 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d" status: 200 len: 1521 microversion: 2.1 time: 0.156807 Jul 21 20:06:18.690858 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 128/279] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:06:18 2022] GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:06:19.707545 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-be8a78d4-04de-4325-a485-2a918253fd82 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:06:19.708177 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-be8a78d4-04de-4325-a485-2a918253fd82 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 514a7771-fbf2-46db-9e3d-905a6a3e703d] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:06:19.714251 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-be8a78d4-04de-4325-a485-2a918253fd82 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:19.714694 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-be8a78d4-04de-4325-a485-2a918253fd82 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:19.715508 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-be8a78d4-04de-4325-a485-2a918253fd82 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:19.715946 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-be8a78d4-04de-4325-a485-2a918253fd82 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:19.845232 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-be8a78d4-04de-4325-a485-2a918253fd82 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:06:19.852777 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-be8a78d4-04de-4325-a485-2a918253fd82 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d" status: 200 len: 1521 microversion: 2.1 time: 0.149797 Jul 21 20:06:19.853336 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 152/280] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:06:19 2022] GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:06:20.870098 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-721b21d3-3bd6-4dd3-9b3a-328e07981174 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:06:20.870704 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-721b21d3-3bd6-4dd3-9b3a-328e07981174 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 514a7771-fbf2-46db-9e3d-905a6a3e703d] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:06:20.877246 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-721b21d3-3bd6-4dd3-9b3a-328e07981174 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:20.877696 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-721b21d3-3bd6-4dd3-9b3a-328e07981174 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:20.878462 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-721b21d3-3bd6-4dd3-9b3a-328e07981174 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:20.879532 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-721b21d3-3bd6-4dd3-9b3a-328e07981174 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:21.007288 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-721b21d3-3bd6-4dd3-9b3a-328e07981174 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:06:21.014680 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-721b21d3-3bd6-4dd3-9b3a-328e07981174 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d" status: 200 len: 1521 microversion: 2.1 time: 0.148541 Jul 21 20:06:21.015299 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 129/281] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:06:20 2022] GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:06:22.032079 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-20649b15-c3f1-4f83-b5c4-983734eb6be8 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:06:22.032676 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-20649b15-c3f1-4f83-b5c4-983734eb6be8 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 514a7771-fbf2-46db-9e3d-905a6a3e703d] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:06:22.038822 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-20649b15-c3f1-4f83-b5c4-983734eb6be8 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:22.039291 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-20649b15-c3f1-4f83-b5c4-983734eb6be8 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:22.040036 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-20649b15-c3f1-4f83-b5c4-983734eb6be8 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:22.040466 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-20649b15-c3f1-4f83-b5c4-983734eb6be8 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:22.177599 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-20649b15-c3f1-4f83-b5c4-983734eb6be8 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:06:22.179271 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-20649b15-c3f1-4f83-b5c4-983734eb6be8 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d" status: 200 len: 1521 microversion: 2.1 time: 0.151031 Jul 21 20:06:22.179839 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 153/282] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:06:22 2022] GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:06:23.196692 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-690394c7-fa74-4dd7-b88b-fd5203fd6843 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:06:23.197327 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-690394c7-fa74-4dd7-b88b-fd5203fd6843 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 514a7771-fbf2-46db-9e3d-905a6a3e703d] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:06:23.204090 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-690394c7-fa74-4dd7-b88b-fd5203fd6843 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:23.204571 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-690394c7-fa74-4dd7-b88b-fd5203fd6843 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:23.205357 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-690394c7-fa74-4dd7-b88b-fd5203fd6843 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:23.205790 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-690394c7-fa74-4dd7-b88b-fd5203fd6843 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:23.336554 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-690394c7-fa74-4dd7-b88b-fd5203fd6843 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:06:23.344679 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-690394c7-fa74-4dd7-b88b-fd5203fd6843 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d" status: 200 len: 1521 microversion: 2.1 time: 0.151935 Jul 21 20:06:23.345254 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 130/283] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:06:23 2022] GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:06:24.361285 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-95ee8099-5d81-42be-9eee-4dbe21de1676 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:06:24.361981 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-95ee8099-5d81-42be-9eee-4dbe21de1676 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 514a7771-fbf2-46db-9e3d-905a6a3e703d] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:06:24.368550 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-95ee8099-5d81-42be-9eee-4dbe21de1676 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:24.368999 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-95ee8099-5d81-42be-9eee-4dbe21de1676 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:24.370029 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-95ee8099-5d81-42be-9eee-4dbe21de1676 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:24.370230 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-95ee8099-5d81-42be-9eee-4dbe21de1676 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:24.499982 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-95ee8099-5d81-42be-9eee-4dbe21de1676 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:06:24.508193 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-95ee8099-5d81-42be-9eee-4dbe21de1676 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d" status: 200 len: 1521 microversion: 2.1 time: 0.150827 Jul 21 20:06:24.508764 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 154/284] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:06:24 2022] GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:06:25.529653 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-3665868e-356e-48f6-99ca-b569ce116dd6 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:06:25.530362 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-3665868e-356e-48f6-99ca-b569ce116dd6 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 514a7771-fbf2-46db-9e3d-905a6a3e703d] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:06:25.537483 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-3665868e-356e-48f6-99ca-b569ce116dd6 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:25.537938 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-3665868e-356e-48f6-99ca-b569ce116dd6 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:25.538702 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-3665868e-356e-48f6-99ca-b569ce116dd6 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:25.539165 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-3665868e-356e-48f6-99ca-b569ce116dd6 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:25.670033 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-3665868e-356e-48f6-99ca-b569ce116dd6 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:06:25.678155 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-3665868e-356e-48f6-99ca-b569ce116dd6 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d" status: 200 len: 1521 microversion: 2.1 time: 0.152375 Jul 21 20:06:25.678727 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 131/285] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:06:25 2022] GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:06:25.797956 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-6b6a1d58-ddaa-455f-94e1-2975486d8184 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:06:25.798511 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-6b6a1d58-ddaa-455f-94e1-2975486d8184 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] [instance: 3c7c536b-2058-4226-938c-65ec0ad3dddc] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:06:25.804640 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6b6a1d58-ddaa-455f-94e1-2975486d8184 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:25.805081 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6b6a1d58-ddaa-455f-94e1-2975486d8184 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:25.805837 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6b6a1d58-ddaa-455f-94e1-2975486d8184 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:25.806435 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6b6a1d58-ddaa-455f-94e1-2975486d8184 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:25.831976 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-6b6a1d58-ddaa-455f-94e1-2975486d8184 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] [instance: 3c7c536b-2058-4226-938c-65ec0ad3dddc] Going to try to terminate instance {{(pid=118345) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 20:06:26.250580 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-6b6a1d58-ddaa-455f-94e1-2975486d8184 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] 10.222.0.58 "DELETE /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc" status: 204 len: 0 microversion: 2.1 time: 0.456074 Jul 21 20:06:26.251194 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 155/286] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Jul 21 20:06:25 2022] DELETE /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc => generated 0 bytes in 458 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 20:06:26.259109 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-5a69fb9c-3b99-4b1a-bb3b-f1c40e1ccb07 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:06:26.259721 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-5a69fb9c-3b99-4b1a-bb3b-f1c40e1ccb07 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] [instance: 3c7c536b-2058-4226-938c-65ec0ad3dddc] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:06:26.266176 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-5a69fb9c-3b99-4b1a-bb3b-f1c40e1ccb07 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:26.266625 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-5a69fb9c-3b99-4b1a-bb3b-f1c40e1ccb07 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:26.267418 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-5a69fb9c-3b99-4b1a-bb3b-f1c40e1ccb07 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:26.267854 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-5a69fb9c-3b99-4b1a-bb3b-f1c40e1ccb07 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:26.401842 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-5a69fb9c-3b99-4b1a-bb3b-f1c40e1ccb07 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0100323b16c045b98dec585b9e59f077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc40ec656240410e862fde9531e0fc55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:06:26.410380 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-5a69fb9c-3b99-4b1a-bb3b-f1c40e1ccb07 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] 10.222.0.58 "GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc" status: 200 len: 1553 microversion: 2.1 time: 0.154664 Jul 21 20:06:26.410960 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 132/287] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:06:26 2022] GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc => generated 1553 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:06:26.696474 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-d0b0b37b-0e10-4138-b783-0ba856517ab7 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:06:26.697223 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-d0b0b37b-0e10-4138-b783-0ba856517ab7 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 514a7771-fbf2-46db-9e3d-905a6a3e703d] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:06:26.703627 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d0b0b37b-0e10-4138-b783-0ba856517ab7 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:26.704068 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d0b0b37b-0e10-4138-b783-0ba856517ab7 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:26.704878 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d0b0b37b-0e10-4138-b783-0ba856517ab7 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:26.705305 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d0b0b37b-0e10-4138-b783-0ba856517ab7 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:26.839274 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-d0b0b37b-0e10-4138-b783-0ba856517ab7 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:06:26.847934 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-d0b0b37b-0e10-4138-b783-0ba856517ab7 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d" status: 200 len: 1521 microversion: 2.1 time: 0.155341 Jul 21 20:06:26.848491 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 156/288] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:06:26 2022] GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:06:27.428050 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-45216548-0037-4d3f-8f74-2454a1b8d17e tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:06:27.428748 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-45216548-0037-4d3f-8f74-2454a1b8d17e tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] [instance: 3c7c536b-2058-4226-938c-65ec0ad3dddc] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:06:27.435179 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-45216548-0037-4d3f-8f74-2454a1b8d17e tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:27.435565 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-45216548-0037-4d3f-8f74-2454a1b8d17e tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:27.436329 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-45216548-0037-4d3f-8f74-2454a1b8d17e tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:27.436762 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-45216548-0037-4d3f-8f74-2454a1b8d17e tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:27.584019 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-45216548-0037-4d3f-8f74-2454a1b8d17e tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0100323b16c045b98dec585b9e59f077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc40ec656240410e862fde9531e0fc55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:06:27.591826 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-45216548-0037-4d3f-8f74-2454a1b8d17e tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] 10.222.0.58 "GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc" status: 200 len: 1553 microversion: 2.1 time: 0.168149 Jul 21 20:06:27.592659 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 133/289] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:06:27 2022] GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc => generated 1553 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:06:27.865884 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-4828c5b1-db24-47a4-ba77-4e874da2033a tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:06:27.866495 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-4828c5b1-db24-47a4-ba77-4e874da2033a tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 514a7771-fbf2-46db-9e3d-905a6a3e703d] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:06:27.868534 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:06:27.873321 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4828c5b1-db24-47a4-ba77-4e874da2033a tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:27.873769 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4828c5b1-db24-47a4-ba77-4e874da2033a tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:27.874533 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4828c5b1-db24-47a4-ba77-4e874da2033a tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:27.874970 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4828c5b1-db24-47a4-ba77-4e874da2033a tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:28.009377 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-4828c5b1-db24-47a4-ba77-4e874da2033a tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:06:28.016675 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-4828c5b1-db24-47a4-ba77-4e874da2033a tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d" status: 200 len: 1521 microversion: 2.1 time: 0.155530 Jul 21 20:06:28.017245 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 157/290] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:06:27 2022] GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:06:28.609222 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-b0942903-7cbc-4ca7-a118-7aafa36de939 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:06:28.609929 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-b0942903-7cbc-4ca7-a118-7aafa36de939 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] [instance: 3c7c536b-2058-4226-938c-65ec0ad3dddc] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:06:28.617641 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-b0942903-7cbc-4ca7-a118-7aafa36de939 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:28.618084 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-b0942903-7cbc-4ca7-a118-7aafa36de939 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:28.618866 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-b0942903-7cbc-4ca7-a118-7aafa36de939 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:28.619336 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-b0942903-7cbc-4ca7-a118-7aafa36de939 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:28.751922 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-b0942903-7cbc-4ca7-a118-7aafa36de939 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0100323b16c045b98dec585b9e59f077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc40ec656240410e862fde9531e0fc55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:06:28.759842 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-b0942903-7cbc-4ca7-a118-7aafa36de939 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] 10.222.0.58 "GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc" status: 200 len: 1553 microversion: 2.1 time: 0.154527 Jul 21 20:06:28.760418 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 134/291] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:06:28 2022] GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc => generated 1553 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:06:29.033350 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-d324eb98-f5c1-45eb-b773-e2bc161ce800 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:06:29.033996 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-d324eb98-f5c1-45eb-b773-e2bc161ce800 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 514a7771-fbf2-46db-9e3d-905a6a3e703d] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:06:29.040726 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d324eb98-f5c1-45eb-b773-e2bc161ce800 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:29.041176 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d324eb98-f5c1-45eb-b773-e2bc161ce800 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:29.041949 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d324eb98-f5c1-45eb-b773-e2bc161ce800 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:29.042385 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d324eb98-f5c1-45eb-b773-e2bc161ce800 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:29.194289 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:06:29.351835 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-d324eb98-f5c1-45eb-b773-e2bc161ce800 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:06:29.359430 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-d324eb98-f5c1-45eb-b773-e2bc161ce800 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d" status: 200 len: 1521 microversion: 2.1 time: 0.329938 Jul 21 20:06:29.359996 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 158/292] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:06:29 2022] GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d => generated 1521 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:06:29.776208 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-c82fddf6-ffb9-4261-8f62-e36a3d9d99e8 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:06:29.776809 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-c82fddf6-ffb9-4261-8f62-e36a3d9d99e8 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] [instance: 3c7c536b-2058-4226-938c-65ec0ad3dddc] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:06:29.783222 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-c82fddf6-ffb9-4261-8f62-e36a3d9d99e8 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:29.783666 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-c82fddf6-ffb9-4261-8f62-e36a3d9d99e8 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:29.784420 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-c82fddf6-ffb9-4261-8f62-e36a3d9d99e8 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:29.784855 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-c82fddf6-ffb9-4261-8f62-e36a3d9d99e8 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:29.920356 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-c82fddf6-ffb9-4261-8f62-e36a3d9d99e8 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0100323b16c045b98dec585b9e59f077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc40ec656240410e862fde9531e0fc55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:06:29.928817 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-c82fddf6-ffb9-4261-8f62-e36a3d9d99e8 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] 10.222.0.58 "GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc" status: 200 len: 1553 microversion: 2.1 time: 0.156538 Jul 21 20:06:29.929368 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 135/293] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:06:29 2022] GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc => generated 1553 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:06:30.380603 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-686159fd-36b0-46ff-ad9c-96011105918a tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:06:30.380603 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-686159fd-36b0-46ff-ad9c-96011105918a tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 514a7771-fbf2-46db-9e3d-905a6a3e703d] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:06:30.388071 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-686159fd-36b0-46ff-ad9c-96011105918a tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:30.388071 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-686159fd-36b0-46ff-ad9c-96011105918a tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:30.388071 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-686159fd-36b0-46ff-ad9c-96011105918a tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:30.388071 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-686159fd-36b0-46ff-ad9c-96011105918a tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:30.564718 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-686159fd-36b0-46ff-ad9c-96011105918a tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:06:30.572785 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-686159fd-36b0-46ff-ad9c-96011105918a tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d" status: 200 len: 1521 microversion: 2.1 time: 0.200382 Jul 21 20:06:30.573346 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 159/294] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:06:30 2022] GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:06:30.755867 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [req-28a19f14-8768-410b-9a4a-b8d6326c04e3 req-d9f19317-ff07-4402-aa8e-3f971ed2d8dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c7c536b-2058-4226-938c-65ec0ad3dddc", "name": "network-vif-deleted", "tag": "d0b6dfdf-6c03-4e2a-a6e3-7065bda3a505"}]} {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:06:30.762172 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [req-28a19f14-8768-410b-9a4a-b8d6326c04e3 req-d9f19317-ff07-4402-aa8e-3f971ed2d8dc service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:30.762603 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [req-28a19f14-8768-410b-9a4a-b8d6326c04e3 req-d9f19317-ff07-4402-aa8e-3f971ed2d8dc service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:30.779716 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.compute.server_external_events [req-28a19f14-8768-410b-9a4a-b8d6326c04e3 req-d9f19317-ff07-4402-aa8e-3f971ed2d8dc service nova] Creating event network-vif-deleted:d0b6dfdf-6c03-4e2a-a6e3-7065bda3a505 for instance 3c7c536b-2058-4226-938c-65ec0ad3dddc on hv-cinder-85054 Jul 21 20:06:30.785831 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [req-28a19f14-8768-410b-9a4a-b8d6326c04e3 req-d9f19317-ff07-4402-aa8e-3f971ed2d8dc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038732 Jul 21 20:06:30.786388 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 136/295] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 20:06:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 20:06:30.952510 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-366f9d79-5fa0-4155-8714-76125c0c1110 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:06:30.952510 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-366f9d79-5fa0-4155-8714-76125c0c1110 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] [instance: 3c7c536b-2058-4226-938c-65ec0ad3dddc] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:06:30.953132 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-366f9d79-5fa0-4155-8714-76125c0c1110 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:30.953574 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-366f9d79-5fa0-4155-8714-76125c0c1110 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:30.954334 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-366f9d79-5fa0-4155-8714-76125c0c1110 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:30.954769 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-366f9d79-5fa0-4155-8714-76125c0c1110 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:31.023521 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-366f9d79-5fa0-4155-8714-76125c0c1110 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0100323b16c045b98dec585b9e59f077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc40ec656240410e862fde9531e0fc55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:06:31.031641 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-366f9d79-5fa0-4155-8714-76125c0c1110 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] 10.222.0.58 "GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc" status: 200 len: 1345 microversion: 2.1 time: 0.089297 Jul 21 20:06:31.032354 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 160/296] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:06:30 2022] GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc => generated 1345 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:06:31.591843 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-8d29b090-94ac-414d-a183-07bc51ad0d99 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:06:31.592795 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-8d29b090-94ac-414d-a183-07bc51ad0d99 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 514a7771-fbf2-46db-9e3d-905a6a3e703d] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:06:31.599617 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-8d29b090-94ac-414d-a183-07bc51ad0d99 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:31.600059 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-8d29b090-94ac-414d-a183-07bc51ad0d99 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:31.600805 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-8d29b090-94ac-414d-a183-07bc51ad0d99 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:31.601239 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-8d29b090-94ac-414d-a183-07bc51ad0d99 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:31.740507 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-8d29b090-94ac-414d-a183-07bc51ad0d99 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:06:31.747863 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-8d29b090-94ac-414d-a183-07bc51ad0d99 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d" status: 200 len: 1521 microversion: 2.1 time: 0.160508 Jul 21 20:06:31.748421 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 137/297] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:06:31 2022] GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:06:32.056014 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-37d39c82-31d3-4126-a8ba-1424ff52f633 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:06:32.056636 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-37d39c82-31d3-4126-a8ba-1424ff52f633 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] [instance: 3c7c536b-2058-4226-938c-65ec0ad3dddc] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:06:32.063112 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-37d39c82-31d3-4126-a8ba-1424ff52f633 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:32.063780 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-37d39c82-31d3-4126-a8ba-1424ff52f633 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:32.064554 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-37d39c82-31d3-4126-a8ba-1424ff52f633 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:32.064984 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-37d39c82-31d3-4126-a8ba-1424ff52f633 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:32.127912 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-37d39c82-31d3-4126-a8ba-1424ff52f633 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0100323b16c045b98dec585b9e59f077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc40ec656240410e862fde9531e0fc55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:06:32.135928 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-37d39c82-31d3-4126-a8ba-1424ff52f633 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] 10.222.0.58 "GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc" status: 200 len: 1345 microversion: 2.1 time: 0.083937 Jul 21 20:06:32.136580 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 161/298] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:06:32 2022] GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc => generated 1345 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:06:32.767009 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-2af24180-6446-4c41-ad37-e2fa35c06c1f tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:06:32.767635 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-2af24180-6446-4c41-ad37-e2fa35c06c1f tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 514a7771-fbf2-46db-9e3d-905a6a3e703d] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:06:32.774593 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-2af24180-6446-4c41-ad37-e2fa35c06c1f tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:32.775051 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-2af24180-6446-4c41-ad37-e2fa35c06c1f tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:32.775823 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-2af24180-6446-4c41-ad37-e2fa35c06c1f tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:32.776294 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-2af24180-6446-4c41-ad37-e2fa35c06c1f tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:32.794765 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG dbcounter [-] [118344] Writing DB stats nova_cell1:SELECT=100 {{(pid=118344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:06:32.904649 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-2af24180-6446-4c41-ad37-e2fa35c06c1f tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:06:32.912147 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-2af24180-6446-4c41-ad37-e2fa35c06c1f tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d" status: 200 len: 1521 microversion: 2.1 time: 0.148985 Jul 21 20:06:32.912720 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 138/299] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:06:32 2022] GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:06:33.153426 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-9588ad21-2a2c-4baf-9bb9-b094703658cd tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:06:33.154033 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-9588ad21-2a2c-4baf-9bb9-b094703658cd tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] [instance: 3c7c536b-2058-4226-938c-65ec0ad3dddc] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:06:33.160432 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-9588ad21-2a2c-4baf-9bb9-b094703658cd tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:33.160971 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-9588ad21-2a2c-4baf-9bb9-b094703658cd tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:33.161666 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-9588ad21-2a2c-4baf-9bb9-b094703658cd tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:33.162100 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-9588ad21-2a2c-4baf-9bb9-b094703658cd tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:33.193714 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-9588ad21-2a2c-4baf-9bb9-b094703658cd tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:33.194152 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-9588ad21-2a2c-4baf-9bb9-b094703658cd tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:33.194608 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.objects.instance [None req-9588ad21-2a2c-4baf-9bb9-b094703658cd tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lazy-loading 'fault' on Instance uuid 3c7c536b-2058-4226-938c-65ec0ad3dddc {{(pid=118345) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 20:06:33.238683 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-9588ad21-2a2c-4baf-9bb9-b094703658cd tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0100323b16c045b98dec585b9e59f077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc40ec656240410e862fde9531e0fc55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:06:33.246434 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-9588ad21-2a2c-4baf-9bb9-b094703658cd tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] 10.222.0.58 "GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc" status: 200 len: 1350 microversion: 2.1 time: 0.096877 Jul 21 20:06:33.246992 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 162/300] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:06:33 2022] GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc => generated 1350 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:06:33.929888 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-7aa496ce-99f8-4ab2-a221-c28048d4685b tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:06:33.930522 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-7aa496ce-99f8-4ab2-a221-c28048d4685b tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 514a7771-fbf2-46db-9e3d-905a6a3e703d] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:06:33.937238 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-7aa496ce-99f8-4ab2-a221-c28048d4685b tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:33.937680 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-7aa496ce-99f8-4ab2-a221-c28048d4685b tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:33.938444 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-7aa496ce-99f8-4ab2-a221-c28048d4685b tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:33.938875 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-7aa496ce-99f8-4ab2-a221-c28048d4685b tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:34.069381 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-7aa496ce-99f8-4ab2-a221-c28048d4685b tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:06:34.077058 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-7aa496ce-99f8-4ab2-a221-c28048d4685b tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d" status: 200 len: 1521 microversion: 2.1 time: 0.151976 Jul 21 20:06:34.077629 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 139/301] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:06:33 2022] GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:06:34.265215 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-62667f27-2d3a-4bd3-b0fe-8984313ce3ed tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:06:34.265722 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-62667f27-2d3a-4bd3-b0fe-8984313ce3ed tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] [instance: 3c7c536b-2058-4226-938c-65ec0ad3dddc] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:06:34.272316 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-62667f27-2d3a-4bd3-b0fe-8984313ce3ed tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:34.272757 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-62667f27-2d3a-4bd3-b0fe-8984313ce3ed tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:34.273514 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-62667f27-2d3a-4bd3-b0fe-8984313ce3ed tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:34.273947 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-62667f27-2d3a-4bd3-b0fe-8984313ce3ed tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:34.287823 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.wsgi [None req-62667f27-2d3a-4bd3-b0fe-8984313ce3ed tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] HTTP exception thrown: Instance 3c7c536b-2058-4226-938c-65ec0ad3dddc could not be found. Jul 21 20:06:34.292387 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-62667f27-2d3a-4bd3-b0fe-8984313ce3ed tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Request method failure captured: Jul 21 20:06:34.292387 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: request: GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc HTTP/1.1 Jul 21 20:06:34.292387 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Accept: application/json Jul 21 20:06:34.292387 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Accept-Encoding: identity Jul 21 20:06:34.292387 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Connection: close Jul 21 20:06:34.292387 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Content-Length: 0 Jul 21 20:06:34.292387 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Content-Type: application/json Jul 21 20:06:34.292387 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Host: 10.222.0.58 Jul 21 20:06:34.292387 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Openstack-System-Scope: None Jul 21 20:06:34.292387 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: User-Agent: python-urllib3/1.26.9 Jul 21 20:06:34.292387 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Auth-Token: gAAAAABi2bFrws4AXArxLzb4mgbQOJKFh7j02JqIVgRAdInpYeBTTLIohAHBNeQryZ-vcaSqw9uxLzCEIt287iiDyBaQZsz0EhYAdQqVhW44NVBFT8XBy5I4xH91Etu5dutYQp5ddR8Nry8lbrU1Y1gUow2J3j8ct5LsQXgPBYMhuNRyF74wE6g Jul 21 20:06:34.292387 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Domain-Id: None Jul 21 20:06:34.292387 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Domain-Name: None Jul 21 20:06:34.292387 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Identity-Status: Confirmed Jul 21 20:06:34.292387 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Is-Admin-Project: True Jul 21 20:06:34.292387 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Id: default Jul 21 20:06:34.292387 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Name: Default Jul 21 20:06:34.292387 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Id: fc40ec656240410e862fde9531e0fc55 Jul 21 20:06:34.292387 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Name: tempest-DeleteServersTestJSON-1801502842 Jul 21 20:06:34.292387 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Role: reader,member Jul 21 20:06:34.292387 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Roles: reader,member Jul 21 20:06:34.293867 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fc40ec656240410e862fde9531e0fc55"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fc40ec656240410e862fde9531e0fc55"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fc40ec656240410e862fde9531e0fc55"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fc40ec656240410e862fde9531e0fc55"}]}] Jul 21 20:06:34.293867 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Tenant: tempest-DeleteServersTestJSON-1801502842 Jul 21 20:06:34.293867 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Tenant-Id: fc40ec656240410e862fde9531e0fc55 Jul 21 20:06:34.293867 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Tenant-Name: tempest-DeleteServersTestJSON-1801502842 Jul 21 20:06:34.293867 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User: tempest-DeleteServersTestJSON-1801502842-project Jul 21 20:06:34.293867 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Id: default Jul 21 20:06:34.293867 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Name: Default Jul 21 20:06:34.293867 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Id: 0100323b16c045b98dec585b9e59f077 Jul 21 20:06:34.293867 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Name: tempest-DeleteServersTestJSON-1801502842-project Jul 21 20:06:34.293867 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: method: > Jul 21 20:06:34.293867 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: exception: Instance 3c7c536b-2058-4226-938c-65ec0ad3dddc could not be found. Jul 21 20:06:34.293867 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: action_args: {'id': '3c7c536b-2058-4226-938c-65ec0ad3dddc'} Jul 21 20:06:34.294725 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 20:06:34.294725 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:06:34.294725 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 20:06:34.294725 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 20:06:34.294725 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 20:06:34.294725 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 20:06:34.294725 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 20:06:34.294725 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 20:06:34.294725 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 20:06:34.294725 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 20:06:34.294725 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c7c536b-2058-4226-938c-65ec0ad3dddc could not be found. Jul 21 20:06:34.294725 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:06:34.294725 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:06:34.294725 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:06:34.294725 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:06:34.294725 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:06:34.294725 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:06:34.294725 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 20:06:34.294725 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 20:06:34.294725 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 20:06:34.299304 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 20:06:34.299304 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 20:06:34.299304 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 20:06:34.299304 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 20:06:34.299304 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 20:06:34.299304 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 20:06:34.299304 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 20:06:34.299304 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c7c536b-2058-4226-938c-65ec0ad3dddc could not be found. Jul 21 20:06:34.299304 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:06:34.299304 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:06:34.299304 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:06:34.299304 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:06:34.299304 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:06:34.299304 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:06:34.299304 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 20:06:34.299304 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 20:06:34.299304 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c7c536b-2058-4226-938c-65ec0ad3dddc could not be found. Jul 21 20:06:34.299304 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:06:34.300481 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-62667f27-2d3a-4bd3-b0fe-8984313ce3ed tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Returning 404 to user: Instance 3c7c536b-2058-4226-938c-65ec0ad3dddc could not be found. {{(pid=118345) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 20:06:34.300481 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-62667f27-2d3a-4bd3-b0fe-8984313ce3ed tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] 10.222.0.58 "GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc" status: 404 len: 111 microversion: 2.1 time: 0.032626 Jul 21 20:06:34.300481 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 163/302] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:06:34 2022] GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 20:06:34.409009 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-7ead257c-a7ad-4c81-a23b-909ed04afe37 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:06:34.410625 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-7ead257c-a7ad-4c81-a23b-909ed04afe37 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] [instance: 3c7c536b-2058-4226-938c-65ec0ad3dddc] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:06:34.417007 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-7ead257c-a7ad-4c81-a23b-909ed04afe37 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:34.417455 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-7ead257c-a7ad-4c81-a23b-909ed04afe37 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:34.418211 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-7ead257c-a7ad-4c81-a23b-909ed04afe37 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:34.418641 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-7ead257c-a7ad-4c81-a23b-909ed04afe37 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:34.431329 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.wsgi [None req-7ead257c-a7ad-4c81-a23b-909ed04afe37 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] HTTP exception thrown: Instance 3c7c536b-2058-4226-938c-65ec0ad3dddc could not be found. Jul 21 20:06:34.435458 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-7ead257c-a7ad-4c81-a23b-909ed04afe37 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Request method failure captured: Jul 21 20:06:34.435458 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: request: GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc/os-volume_attachments HTTP/1.1 Jul 21 20:06:34.435458 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Accept: application/json Jul 21 20:06:34.435458 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Accept-Encoding: identity Jul 21 20:06:34.435458 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Connection: close Jul 21 20:06:34.435458 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Content-Length: 0 Jul 21 20:06:34.435458 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Content-Type: application/json Jul 21 20:06:34.435458 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Host: 10.222.0.58 Jul 21 20:06:34.435458 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Openstack-System-Scope: None Jul 21 20:06:34.435458 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: User-Agent: python-urllib3/1.26.9 Jul 21 20:06:34.435458 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Auth-Token: gAAAAABi2bFrws4AXArxLzb4mgbQOJKFh7j02JqIVgRAdInpYeBTTLIohAHBNeQryZ-vcaSqw9uxLzCEIt287iiDyBaQZsz0EhYAdQqVhW44NVBFT8XBy5I4xH91Etu5dutYQp5ddR8Nry8lbrU1Y1gUow2J3j8ct5LsQXgPBYMhuNRyF74wE6g Jul 21 20:06:34.435458 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Domain-Id: None Jul 21 20:06:34.435458 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Domain-Name: None Jul 21 20:06:34.435458 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Identity-Status: Confirmed Jul 21 20:06:34.435458 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Is-Admin-Project: True Jul 21 20:06:34.435458 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Domain-Id: default Jul 21 20:06:34.435458 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Domain-Name: Default Jul 21 20:06:34.435458 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Id: fc40ec656240410e862fde9531e0fc55 Jul 21 20:06:34.435458 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Name: tempest-DeleteServersTestJSON-1801502842 Jul 21 20:06:34.435458 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Role: reader,member Jul 21 20:06:34.435458 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Roles: reader,member Jul 21 20:06:34.436884 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fc40ec656240410e862fde9531e0fc55"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fc40ec656240410e862fde9531e0fc55"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fc40ec656240410e862fde9531e0fc55"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fc40ec656240410e862fde9531e0fc55"}]}] Jul 21 20:06:34.436884 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Tenant: tempest-DeleteServersTestJSON-1801502842 Jul 21 20:06:34.436884 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Tenant-Id: fc40ec656240410e862fde9531e0fc55 Jul 21 20:06:34.436884 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Tenant-Name: tempest-DeleteServersTestJSON-1801502842 Jul 21 20:06:34.436884 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User: tempest-DeleteServersTestJSON-1801502842-project Jul 21 20:06:34.436884 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Domain-Id: default Jul 21 20:06:34.436884 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Domain-Name: Default Jul 21 20:06:34.436884 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Id: 0100323b16c045b98dec585b9e59f077 Jul 21 20:06:34.436884 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Name: tempest-DeleteServersTestJSON-1801502842-project Jul 21 20:06:34.436884 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: method: > Jul 21 20:06:34.436884 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: exception: Instance 3c7c536b-2058-4226-938c-65ec0ad3dddc could not be found. Jul 21 20:06:34.436884 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: action_args: {'server_id': '3c7c536b-2058-4226-938c-65ec0ad3dddc'} Jul 21 20:06:34.437557 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 20:06:34.437557 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:06:34.437557 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 20:06:34.437557 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 20:06:34.437557 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 20:06:34.437557 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 20:06:34.437557 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 20:06:34.437557 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 20:06:34.437557 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 20:06:34.437557 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 20:06:34.437557 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c7c536b-2058-4226-938c-65ec0ad3dddc could not be found. Jul 21 20:06:34.437557 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:06:34.437557 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:06:34.437557 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:06:34.437557 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:06:34.437557 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:06:34.437557 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:06:34.437557 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 20:06:34.437557 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 20:06:34.437557 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 20:06:34.438577 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 20:06:34.438577 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 21 20:06:34.438577 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 20:06:34.438577 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 21 20:06:34.438577 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 20:06:34.438577 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 21 20:06:34.438577 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 21 20:06:34.438577 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 20:06:34.438577 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 20:06:34.438577 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c7c536b-2058-4226-938c-65ec0ad3dddc could not be found. Jul 21 20:06:34.438577 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:06:34.438577 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:06:34.438577 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:06:34.438577 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:06:34.438577 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:06:34.438577 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:06:34.438577 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 20:06:34.438577 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 20:06:34.438577 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c7c536b-2058-4226-938c-65ec0ad3dddc could not be found. Jul 21 20:06:34.438577 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:06:34.440124 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-7ead257c-a7ad-4c81-a23b-909ed04afe37 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Returning 404 to user: Instance 3c7c536b-2058-4226-938c-65ec0ad3dddc could not be found. {{(pid=118344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 20:06:34.440124 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-7ead257c-a7ad-4c81-a23b-909ed04afe37 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] 10.222.0.58 "GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032185 Jul 21 20:06:34.440124 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 140/303] 10.222.0.58 () {58 vars in 1301 bytes} [Thu Jul 21 20:06:34 2022] GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc/os-volume_attachments => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 20:06:35.094690 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-bf1fa74e-6ab4-4a2e-8feb-4a5ea72adcae tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:06:35.095334 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-bf1fa74e-6ab4-4a2e-8feb-4a5ea72adcae tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 514a7771-fbf2-46db-9e3d-905a6a3e703d] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:06:35.101603 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-bf1fa74e-6ab4-4a2e-8feb-4a5ea72adcae tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:35.102045 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-bf1fa74e-6ab4-4a2e-8feb-4a5ea72adcae tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:35.102821 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-bf1fa74e-6ab4-4a2e-8feb-4a5ea72adcae tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:35.103273 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-bf1fa74e-6ab4-4a2e-8feb-4a5ea72adcae tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:35.238888 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-bf1fa74e-6ab4-4a2e-8feb-4a5ea72adcae tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:06:35.246379 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-bf1fa74e-6ab4-4a2e-8feb-4a5ea72adcae tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d" status: 200 len: 1521 microversion: 2.1 time: 0.155797 Jul 21 20:06:35.246942 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 164/304] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:06:35 2022] GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:06:35.802673 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-c324bfa7-76b4-4525-a406-90cca10b0261 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:06:35.805444 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-c324bfa7-76b4-4525-a406-90cca10b0261 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] [instance: 3c7c536b-2058-4226-938c-65ec0ad3dddc] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:06:35.810427 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-c324bfa7-76b4-4525-a406-90cca10b0261 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:35.810875 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-c324bfa7-76b4-4525-a406-90cca10b0261 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:35.811665 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-c324bfa7-76b4-4525-a406-90cca10b0261 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:35.812099 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-c324bfa7-76b4-4525-a406-90cca10b0261 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:35.826338 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.wsgi [None req-c324bfa7-76b4-4525-a406-90cca10b0261 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] HTTP exception thrown: Instance 3c7c536b-2058-4226-938c-65ec0ad3dddc could not be found. Jul 21 20:06:35.828941 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-c324bfa7-76b4-4525-a406-90cca10b0261 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Request method failure captured: Jul 21 20:06:35.828941 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: request: DELETE /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc HTTP/1.1 Jul 21 20:06:35.828941 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Accept: application/json Jul 21 20:06:35.828941 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Accept-Encoding: identity Jul 21 20:06:35.828941 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Connection: close Jul 21 20:06:35.828941 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Content-Length: 0 Jul 21 20:06:35.828941 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Content-Type: application/json Jul 21 20:06:35.828941 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Host: 10.222.0.58 Jul 21 20:06:35.828941 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Openstack-System-Scope: None Jul 21 20:06:35.828941 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: User-Agent: python-urllib3/1.26.9 Jul 21 20:06:35.828941 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Auth-Token: gAAAAABi2bFrws4AXArxLzb4mgbQOJKFh7j02JqIVgRAdInpYeBTTLIohAHBNeQryZ-vcaSqw9uxLzCEIt287iiDyBaQZsz0EhYAdQqVhW44NVBFT8XBy5I4xH91Etu5dutYQp5ddR8Nry8lbrU1Y1gUow2J3j8ct5LsQXgPBYMhuNRyF74wE6g Jul 21 20:06:35.828941 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Domain-Id: None Jul 21 20:06:35.828941 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Domain-Name: None Jul 21 20:06:35.828941 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Identity-Status: Confirmed Jul 21 20:06:35.828941 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Is-Admin-Project: True Jul 21 20:06:35.828941 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Domain-Id: default Jul 21 20:06:35.828941 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Domain-Name: Default Jul 21 20:06:35.828941 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Id: fc40ec656240410e862fde9531e0fc55 Jul 21 20:06:35.828941 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Name: tempest-DeleteServersTestJSON-1801502842 Jul 21 20:06:35.828941 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Role: reader,member Jul 21 20:06:35.828941 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Roles: reader,member Jul 21 20:06:35.830898 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fc40ec656240410e862fde9531e0fc55"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fc40ec656240410e862fde9531e0fc55"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fc40ec656240410e862fde9531e0fc55"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fc40ec656240410e862fde9531e0fc55"}]}] Jul 21 20:06:35.830898 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Tenant: tempest-DeleteServersTestJSON-1801502842 Jul 21 20:06:35.830898 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Tenant-Id: fc40ec656240410e862fde9531e0fc55 Jul 21 20:06:35.830898 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Tenant-Name: tempest-DeleteServersTestJSON-1801502842 Jul 21 20:06:35.830898 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User: tempest-DeleteServersTestJSON-1801502842-project Jul 21 20:06:35.830898 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Domain-Id: default Jul 21 20:06:35.830898 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Domain-Name: Default Jul 21 20:06:35.830898 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Id: 0100323b16c045b98dec585b9e59f077 Jul 21 20:06:35.830898 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Name: tempest-DeleteServersTestJSON-1801502842-project Jul 21 20:06:35.830898 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: method: > Jul 21 20:06:35.830898 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: exception: Instance 3c7c536b-2058-4226-938c-65ec0ad3dddc could not be found. Jul 21 20:06:35.830898 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: action_args: {'id': '3c7c536b-2058-4226-938c-65ec0ad3dddc'} Jul 21 20:06:35.831945 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 20:06:35.831945 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:06:35.831945 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 20:06:35.831945 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 20:06:35.831945 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 20:06:35.831945 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 20:06:35.831945 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 20:06:35.831945 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 20:06:35.831945 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 20:06:35.831945 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 20:06:35.831945 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c7c536b-2058-4226-938c-65ec0ad3dddc could not be found. Jul 21 20:06:35.831945 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:06:35.831945 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:06:35.831945 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:06:35.831945 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:06:35.831945 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:06:35.831945 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:06:35.831945 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 20:06:35.831945 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 20:06:35.831945 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 20:06:35.833676 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 20:06:35.833676 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 20:06:35.833676 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 20:06:35.833676 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 20:06:35.833676 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 20:06:35.833676 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 20:06:35.833676 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 20:06:35.833676 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 20:06:35.833676 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 20:06:35.833676 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c7c536b-2058-4226-938c-65ec0ad3dddc could not be found. Jul 21 20:06:35.833676 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:06:35.833676 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:06:35.833676 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:06:35.833676 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:06:35.833676 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:06:35.833676 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:06:35.833676 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 20:06:35.833676 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 20:06:35.833676 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c7c536b-2058-4226-938c-65ec0ad3dddc could not be found. Jul 21 20:06:35.833676 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:06:35.839500 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-c324bfa7-76b4-4525-a406-90cca10b0261 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Returning 404 to user: Instance 3c7c536b-2058-4226-938c-65ec0ad3dddc could not be found. {{(pid=118344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 20:06:35.839500 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-c324bfa7-76b4-4525-a406-90cca10b0261 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] 10.222.0.58 "DELETE /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc" status: 404 len: 111 microversion: 2.1 time: 0.032467 Jul 21 20:06:35.839500 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 141/305] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Jul 21 20:06:35 2022] DELETE /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 20:06:35.839746 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-0a4de72e-f47c-4048-838c-a7979f39c795 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:06:35.840249 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-0a4de72e-f47c-4048-838c-a7979f39c795 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] [instance: 3c7c536b-2058-4226-938c-65ec0ad3dddc] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:06:35.846471 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0a4de72e-f47c-4048-838c-a7979f39c795 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:35.846915 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0a4de72e-f47c-4048-838c-a7979f39c795 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:35.847712 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0a4de72e-f47c-4048-838c-a7979f39c795 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:35.848148 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0a4de72e-f47c-4048-838c-a7979f39c795 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:35.861428 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.wsgi [None req-0a4de72e-f47c-4048-838c-a7979f39c795 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] HTTP exception thrown: Instance 3c7c536b-2058-4226-938c-65ec0ad3dddc could not be found. Jul 21 20:06:35.863587 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-0a4de72e-f47c-4048-838c-a7979f39c795 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Request method failure captured: Jul 21 20:06:35.863587 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: request: GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc HTTP/1.1 Jul 21 20:06:35.863587 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Accept: application/json Jul 21 20:06:35.863587 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Accept-Encoding: identity Jul 21 20:06:35.863587 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Connection: close Jul 21 20:06:35.863587 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Content-Length: 0 Jul 21 20:06:35.863587 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Content-Type: application/json Jul 21 20:06:35.863587 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Host: 10.222.0.58 Jul 21 20:06:35.863587 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Openstack-System-Scope: None Jul 21 20:06:35.863587 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: User-Agent: python-urllib3/1.26.9 Jul 21 20:06:35.863587 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Auth-Token: gAAAAABi2bFrws4AXArxLzb4mgbQOJKFh7j02JqIVgRAdInpYeBTTLIohAHBNeQryZ-vcaSqw9uxLzCEIt287iiDyBaQZsz0EhYAdQqVhW44NVBFT8XBy5I4xH91Etu5dutYQp5ddR8Nry8lbrU1Y1gUow2J3j8ct5LsQXgPBYMhuNRyF74wE6g Jul 21 20:06:35.863587 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Domain-Id: None Jul 21 20:06:35.863587 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Domain-Name: None Jul 21 20:06:35.863587 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Identity-Status: Confirmed Jul 21 20:06:35.863587 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Is-Admin-Project: True Jul 21 20:06:35.863587 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Id: default Jul 21 20:06:35.863587 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Name: Default Jul 21 20:06:35.863587 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Id: fc40ec656240410e862fde9531e0fc55 Jul 21 20:06:35.863587 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Name: tempest-DeleteServersTestJSON-1801502842 Jul 21 20:06:35.863587 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Role: reader,member Jul 21 20:06:35.863587 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Roles: reader,member Jul 21 20:06:35.864972 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fc40ec656240410e862fde9531e0fc55"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fc40ec656240410e862fde9531e0fc55"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fc40ec656240410e862fde9531e0fc55"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fc40ec656240410e862fde9531e0fc55"}]}] Jul 21 20:06:35.864972 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Tenant: tempest-DeleteServersTestJSON-1801502842 Jul 21 20:06:35.864972 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Tenant-Id: fc40ec656240410e862fde9531e0fc55 Jul 21 20:06:35.864972 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Tenant-Name: tempest-DeleteServersTestJSON-1801502842 Jul 21 20:06:35.864972 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User: tempest-DeleteServersTestJSON-1801502842-project Jul 21 20:06:35.864972 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Id: default Jul 21 20:06:35.864972 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Name: Default Jul 21 20:06:35.864972 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Id: 0100323b16c045b98dec585b9e59f077 Jul 21 20:06:35.864972 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Name: tempest-DeleteServersTestJSON-1801502842-project Jul 21 20:06:35.864972 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: method: > Jul 21 20:06:35.864972 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: exception: Instance 3c7c536b-2058-4226-938c-65ec0ad3dddc could not be found. Jul 21 20:06:35.864972 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: action_args: {'id': '3c7c536b-2058-4226-938c-65ec0ad3dddc'} Jul 21 20:06:35.865849 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 20:06:35.865849 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:06:35.865849 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 20:06:35.865849 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 20:06:35.865849 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 20:06:35.865849 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 20:06:35.865849 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 20:06:35.865849 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 20:06:35.865849 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 20:06:35.865849 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 20:06:35.865849 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c7c536b-2058-4226-938c-65ec0ad3dddc could not be found. Jul 21 20:06:35.865849 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:06:35.865849 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:06:35.865849 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:06:35.865849 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:06:35.865849 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:06:35.865849 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:06:35.865849 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 20:06:35.865849 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 20:06:35.865849 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 20:06:35.867238 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 20:06:35.867238 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 20:06:35.867238 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 20:06:35.867238 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 20:06:35.867238 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 20:06:35.867238 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 20:06:35.867238 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 20:06:35.867238 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c7c536b-2058-4226-938c-65ec0ad3dddc could not be found. Jul 21 20:06:35.867238 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:06:35.867238 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:06:35.867238 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:06:35.867238 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:06:35.867238 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:06:35.867238 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:06:35.867238 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 20:06:35.867238 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 20:06:35.867238 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c7c536b-2058-4226-938c-65ec0ad3dddc could not be found. Jul 21 20:06:35.867238 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:06:35.868187 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-0a4de72e-f47c-4048-838c-a7979f39c795 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] Returning 404 to user: Instance 3c7c536b-2058-4226-938c-65ec0ad3dddc could not be found. {{(pid=118345) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 20:06:35.868187 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-0a4de72e-f47c-4048-838c-a7979f39c795 tempest-DeleteServersTestJSON-1801502842 tempest-DeleteServersTestJSON-1801502842-project] 10.222.0.58 "GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc" status: 404 len: 111 microversion: 2.1 time: 0.029285 Jul 21 20:06:35.868187 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 165/306] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:06:35 2022] GET /compute/v2.1/servers/3c7c536b-2058-4226-938c-65ec0ad3dddc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 21 20:06:36.263477 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-1eb00b36-7beb-4b1f-8aa2-e148672562a0 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:06:36.264085 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-1eb00b36-7beb-4b1f-8aa2-e148672562a0 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 514a7771-fbf2-46db-9e3d-905a6a3e703d] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:06:36.271186 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-1eb00b36-7beb-4b1f-8aa2-e148672562a0 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:36.271631 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-1eb00b36-7beb-4b1f-8aa2-e148672562a0 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:36.272397 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-1eb00b36-7beb-4b1f-8aa2-e148672562a0 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:36.272820 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-1eb00b36-7beb-4b1f-8aa2-e148672562a0 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:36.411728 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-1eb00b36-7beb-4b1f-8aa2-e148672562a0 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:06:36.421388 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-1eb00b36-7beb-4b1f-8aa2-e148672562a0 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d" status: 200 len: 1521 microversion: 2.1 time: 0.161948 Jul 21 20:06:36.421988 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 142/307] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:06:36 2022] GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:06:37.438595 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-8e6c2b8e-e05c-4e2c-bfe3-acf0b4c554b5 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:06:37.439159 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-8e6c2b8e-e05c-4e2c-bfe3-acf0b4c554b5 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 514a7771-fbf2-46db-9e3d-905a6a3e703d] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:06:37.445657 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8e6c2b8e-e05c-4e2c-bfe3-acf0b4c554b5 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:37.446103 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8e6c2b8e-e05c-4e2c-bfe3-acf0b4c554b5 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:37.446872 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8e6c2b8e-e05c-4e2c-bfe3-acf0b4c554b5 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:37.447322 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8e6c2b8e-e05c-4e2c-bfe3-acf0b4c554b5 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:37.658216 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-8e6c2b8e-e05c-4e2c-bfe3-acf0b4c554b5 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:06:37.666692 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-8e6c2b8e-e05c-4e2c-bfe3-acf0b4c554b5 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d" status: 200 len: 1521 microversion: 2.1 time: 0.231960 Jul 21 20:06:37.667438 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 166/308] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:06:37 2022] GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d => generated 1521 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:06:38.684855 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-4b2c3d92-cad8-42b4-bd5a-a1084be14c50 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:06:38.685581 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-4b2c3d92-cad8-42b4-bd5a-a1084be14c50 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 514a7771-fbf2-46db-9e3d-905a6a3e703d] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:06:38.692838 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-4b2c3d92-cad8-42b4-bd5a-a1084be14c50 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:38.693290 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-4b2c3d92-cad8-42b4-bd5a-a1084be14c50 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:38.694050 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-4b2c3d92-cad8-42b4-bd5a-a1084be14c50 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:38.694479 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-4b2c3d92-cad8-42b4-bd5a-a1084be14c50 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:38.831650 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-4b2c3d92-cad8-42b4-bd5a-a1084be14c50 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:06:38.839157 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-4b2c3d92-cad8-42b4-bd5a-a1084be14c50 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d" status: 200 len: 1521 microversion: 2.1 time: 0.159704 Jul 21 20:06:38.840314 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 143/309] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:06:38 2022] GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:06:39.859642 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-bc2d0eb8-4078-424f-9c57-cdd084d7b112 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:06:39.860281 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-bc2d0eb8-4078-424f-9c57-cdd084d7b112 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 514a7771-fbf2-46db-9e3d-905a6a3e703d] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:06:39.867789 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-bc2d0eb8-4078-424f-9c57-cdd084d7b112 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:39.868235 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-bc2d0eb8-4078-424f-9c57-cdd084d7b112 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:39.869001 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-bc2d0eb8-4078-424f-9c57-cdd084d7b112 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:39.869467 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-bc2d0eb8-4078-424f-9c57-cdd084d7b112 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:40.085183 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-bc2d0eb8-4078-424f-9c57-cdd084d7b112 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:06:40.092975 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-bc2d0eb8-4078-424f-9c57-cdd084d7b112 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d" status: 200 len: 1521 microversion: 2.1 time: 0.237643 Jul 21 20:06:40.093526 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 167/310] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:06:39 2022] GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d => generated 1521 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:06:41.109730 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-44ed8e5a-e3b0-43a3-9c95-8d5a5af56c07 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:06:41.110320 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-44ed8e5a-e3b0-43a3-9c95-8d5a5af56c07 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 514a7771-fbf2-46db-9e3d-905a6a3e703d] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:06:41.117619 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-44ed8e5a-e3b0-43a3-9c95-8d5a5af56c07 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:41.117993 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-44ed8e5a-e3b0-43a3-9c95-8d5a5af56c07 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:41.118675 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-44ed8e5a-e3b0-43a3-9c95-8d5a5af56c07 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:41.119221 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-44ed8e5a-e3b0-43a3-9c95-8d5a5af56c07 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:41.257966 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-44ed8e5a-e3b0-43a3-9c95-8d5a5af56c07 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:06:41.265842 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-44ed8e5a-e3b0-43a3-9c95-8d5a5af56c07 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d" status: 200 len: 1521 microversion: 2.1 time: 0.159981 Jul 21 20:06:41.266415 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 144/311] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:06:41 2022] GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:06:42.269359 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-8f7634fc-8980-444f-bcf6-cfcd61425e38 tempest-VolumesGetTestJSON-1669530346 tempest-VolumesGetTestJSON-1669530346-project] Action: 'create', calling method: .version_select at 0x7f351cf819d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1139860069", "metadata": {"Type": "work"}}} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:06:42.281454 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-5d2592e1-21ba-42eb-8a22-44050f24fd29 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:06:42.282149 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-5d2592e1-21ba-42eb-8a22-44050f24fd29 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 514a7771-fbf2-46db-9e3d-905a6a3e703d] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:06:42.289424 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-5d2592e1-21ba-42eb-8a22-44050f24fd29 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:42.289872 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-5d2592e1-21ba-42eb-8a22-44050f24fd29 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:42.290632 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-5d2592e1-21ba-42eb-8a22-44050f24fd29 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:42.291084 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-5d2592e1-21ba-42eb-8a22-44050f24fd29 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:42.424817 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-5d2592e1-21ba-42eb-8a22-44050f24fd29 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:06:42.432733 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-5d2592e1-21ba-42eb-8a22-44050f24fd29 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d" status: 200 len: 1521 microversion: 2.1 time: 0.155062 Jul 21 20:06:42.433550 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 145/312] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:06:42 2022] GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:06:43.063779 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-8f7634fc-8980-444f-bcf6-cfcd61425e38 tempest-VolumesGetTestJSON-1669530346 tempest-VolumesGetTestJSON-1669530346-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.907827 Jul 21 20:06:43.064407 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 168/313] 10.222.0.58 () {60 vars in 1155 bytes} [Thu Jul 21 20:06:42 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 909 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 21 20:06:43.076129 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-d4bc36e4-bd72-47bf-bdfe-48a57f0bdc8c tempest-VolumesGetTestJSON-1669530346 tempest-VolumesGetTestJSON-1669530346-project] Calling method '.version_select at 0x7f351ce2d940>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:06:43.126672 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-d4bc36e4-bd72-47bf-bdfe-48a57f0bdc8c tempest-VolumesGetTestJSON-1669530346 tempest-VolumesGetTestJSON-1669530346-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/9fa52160-d78d-4999-9404-b3e82643ab1e" status: 200 len: 353 microversion: 2.1 time: 0.054416 Jul 21 20:06:43.127291 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 146/314] 10.222.0.58 () {58 vars in 1244 bytes} [Thu Jul 21 20:06:43 2022] GET /compute/v2.1/os-volumes/9fa52160-d78d-4999-9404-b3e82643ab1e => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:06:43.449475 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-caa3fd1d-1e81-4c83-a18c-28320e9c8af7 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:06:43.450082 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-caa3fd1d-1e81-4c83-a18c-28320e9c8af7 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 514a7771-fbf2-46db-9e3d-905a6a3e703d] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:06:43.456147 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-caa3fd1d-1e81-4c83-a18c-28320e9c8af7 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:43.456598 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-caa3fd1d-1e81-4c83-a18c-28320e9c8af7 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:43.457361 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-caa3fd1d-1e81-4c83-a18c-28320e9c8af7 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:43.457806 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-caa3fd1d-1e81-4c83-a18c-28320e9c8af7 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:43.587821 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-caa3fd1d-1e81-4c83-a18c-28320e9c8af7 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:06:43.595491 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-caa3fd1d-1e81-4c83-a18c-28320e9c8af7 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d" status: 200 len: 1521 microversion: 2.1 time: 0.149932 Jul 21 20:06:43.596045 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 169/315] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:06:43 2022] GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:06:44.145515 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-79339ba8-ee86-4bec-95cb-1a1649f5c12b tempest-VolumesGetTestJSON-1669530346 tempest-VolumesGetTestJSON-1669530346-project] Calling method '.version_select at 0x7f351ce329d0>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:06:44.192491 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-79339ba8-ee86-4bec-95cb-1a1649f5c12b tempest-VolumesGetTestJSON-1669530346 tempest-VolumesGetTestJSON-1669530346-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/9fa52160-d78d-4999-9404-b3e82643ab1e" status: 200 len: 353 microversion: 2.1 time: 0.050783 Jul 21 20:06:44.193143 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 147/316] 10.222.0.58 () {58 vars in 1244 bytes} [Thu Jul 21 20:06:44 2022] GET /compute/v2.1/os-volumes/9fa52160-d78d-4999-9404-b3e82643ab1e => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:06:44.613001 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-72da400e-7e2b-4008-bf72-050cdd7c31eb tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:06:44.613613 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-72da400e-7e2b-4008-bf72-050cdd7c31eb tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 514a7771-fbf2-46db-9e3d-905a6a3e703d] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:06:44.619555 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-72da400e-7e2b-4008-bf72-050cdd7c31eb tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:44.620000 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-72da400e-7e2b-4008-bf72-050cdd7c31eb tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:44.620763 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-72da400e-7e2b-4008-bf72-050cdd7c31eb tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:44.621195 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-72da400e-7e2b-4008-bf72-050cdd7c31eb tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:44.750187 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-72da400e-7e2b-4008-bf72-050cdd7c31eb tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:06:44.757988 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-72da400e-7e2b-4008-bf72-050cdd7c31eb tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d" status: 200 len: 1521 microversion: 2.1 time: 0.149280 Jul 21 20:06:44.758549 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 170/317] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:06:44 2022] GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:06:45.205622 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-ffa8d8c8-9219-4943-8660-fb8e866ddb5d tempest-VolumesGetTestJSON-1669530346 tempest-VolumesGetTestJSON-1669530346-project] Calling method '.version_select at 0x7f351cdd5310>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:06:45.254466 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-ffa8d8c8-9219-4943-8660-fb8e866ddb5d tempest-VolumesGetTestJSON-1669530346 tempest-VolumesGetTestJSON-1669530346-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/9fa52160-d78d-4999-9404-b3e82643ab1e" status: 200 len: 353 microversion: 2.1 time: 0.053217 Jul 21 20:06:45.255057 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 148/318] 10.222.0.58 () {58 vars in 1244 bytes} [Thu Jul 21 20:06:45 2022] GET /compute/v2.1/os-volumes/9fa52160-d78d-4999-9404-b3e82643ab1e => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:06:45.775311 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-3f11b9e3-9a38-4838-b89b-e6ddf29e7084 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:06:45.775982 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-3f11b9e3-9a38-4838-b89b-e6ddf29e7084 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 514a7771-fbf2-46db-9e3d-905a6a3e703d] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:06:45.782584 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3f11b9e3-9a38-4838-b89b-e6ddf29e7084 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:45.783045 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3f11b9e3-9a38-4838-b89b-e6ddf29e7084 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:45.783818 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3f11b9e3-9a38-4838-b89b-e6ddf29e7084 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:45.784302 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3f11b9e3-9a38-4838-b89b-e6ddf29e7084 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:45.913652 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-3f11b9e3-9a38-4838-b89b-e6ddf29e7084 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:06:45.921008 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-3f11b9e3-9a38-4838-b89b-e6ddf29e7084 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d" status: 200 len: 1521 microversion: 2.1 time: 0.149886 Jul 21 20:06:45.921563 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 171/319] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:06:45 2022] GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:06:46.268041 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-6b916650-837a-46ce-b932-96d885420d57 tempest-VolumesGetTestJSON-1669530346 tempest-VolumesGetTestJSON-1669530346-project] Calling method '.version_select at 0x7f351ce2df70>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:06:46.321016 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-6b916650-837a-46ce-b932-96d885420d57 tempest-VolumesGetTestJSON-1669530346 tempest-VolumesGetTestJSON-1669530346-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/9fa52160-d78d-4999-9404-b3e82643ab1e" status: 200 len: 353 microversion: 2.1 time: 0.057730 Jul 21 20:06:46.327124 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 149/320] 10.222.0.58 () {58 vars in 1244 bytes} [Thu Jul 21 20:06:46 2022] GET /compute/v2.1/os-volumes/9fa52160-d78d-4999-9404-b3e82643ab1e => generated 353 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:06:46.938249 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-6d74b475-b429-40da-b26c-1cab25996c1e tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:06:46.938884 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-6d74b475-b429-40da-b26c-1cab25996c1e tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 514a7771-fbf2-46db-9e3d-905a6a3e703d] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:06:46.946330 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6d74b475-b429-40da-b26c-1cab25996c1e tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:46.946860 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6d74b475-b429-40da-b26c-1cab25996c1e tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:46.947727 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6d74b475-b429-40da-b26c-1cab25996c1e tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:46.948165 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6d74b475-b429-40da-b26c-1cab25996c1e tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:47.079690 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-6d74b475-b429-40da-b26c-1cab25996c1e tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:06:47.087210 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-6d74b475-b429-40da-b26c-1cab25996c1e tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d" status: 200 len: 1521 microversion: 2.1 time: 0.152794 Jul 21 20:06:47.087772 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 172/321] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:06:46 2022] GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:06:47.337341 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-f7385457-6660-43c1-9c13-bb6c0a38a337 tempest-VolumesGetTestJSON-1669530346 tempest-VolumesGetTestJSON-1669530346-project] Calling method '.version_select at 0x7f351cf17ee0>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:06:47.386105 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-f7385457-6660-43c1-9c13-bb6c0a38a337 tempest-VolumesGetTestJSON-1669530346 tempest-VolumesGetTestJSON-1669530346-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/9fa52160-d78d-4999-9404-b3e82643ab1e" status: 200 len: 353 microversion: 2.1 time: 0.052958 Jul 21 20:06:47.386674 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 150/322] 10.222.0.58 () {58 vars in 1244 bytes} [Thu Jul 21 20:06:47 2022] GET /compute/v2.1/os-volumes/9fa52160-d78d-4999-9404-b3e82643ab1e => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:06:48.104090 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-efc67f85-4b2c-4bb9-93c6-e9ccb3ed3de3 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:06:48.104883 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-efc67f85-4b2c-4bb9-93c6-e9ccb3ed3de3 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 514a7771-fbf2-46db-9e3d-905a6a3e703d] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:06:48.110649 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-efc67f85-4b2c-4bb9-93c6-e9ccb3ed3de3 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:48.111166 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-efc67f85-4b2c-4bb9-93c6-e9ccb3ed3de3 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:48.111950 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-efc67f85-4b2c-4bb9-93c6-e9ccb3ed3de3 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:48.112383 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-efc67f85-4b2c-4bb9-93c6-e9ccb3ed3de3 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:48.248026 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-efc67f85-4b2c-4bb9-93c6-e9ccb3ed3de3 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:06:48.257947 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-efc67f85-4b2c-4bb9-93c6-e9ccb3ed3de3 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d" status: 200 len: 1521 microversion: 2.1 time: 0.157474 Jul 21 20:06:48.258523 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 173/323] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:06:48 2022] GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:06:48.398394 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-72bd1cfc-0ea0-441c-ad66-db4a8ec2fae0 tempest-VolumesGetTestJSON-1669530346 tempest-VolumesGetTestJSON-1669530346-project] Calling method '.version_select at 0x7f351d095ca0>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:06:48.449770 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-72bd1cfc-0ea0-441c-ad66-db4a8ec2fae0 tempest-VolumesGetTestJSON-1669530346 tempest-VolumesGetTestJSON-1669530346-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/9fa52160-d78d-4999-9404-b3e82643ab1e" status: 200 len: 354 microversion: 2.1 time: 0.056079 Jul 21 20:06:48.450336 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 151/324] 10.222.0.58 () {58 vars in 1244 bytes} [Thu Jul 21 20:06:48 2022] GET /compute/v2.1/os-volumes/9fa52160-d78d-4999-9404-b3e82643ab1e => generated 354 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:06:48.461877 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-e1881004-324d-45a5-aec8-e2666c55f21e tempest-VolumesGetTestJSON-1669530346 tempest-VolumesGetTestJSON-1669530346-project] Calling method '.version_select at 0x7f351cfa9790>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:06:48.509657 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-e1881004-324d-45a5-aec8-e2666c55f21e tempest-VolumesGetTestJSON-1669530346 tempest-VolumesGetTestJSON-1669530346-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/9fa52160-d78d-4999-9404-b3e82643ab1e" status: 200 len: 354 microversion: 2.1 time: 0.051475 Jul 21 20:06:48.510196 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 174/325] 10.222.0.58 () {58 vars in 1244 bytes} [Thu Jul 21 20:06:48 2022] GET /compute/v2.1/os-volumes/9fa52160-d78d-4999-9404-b3e82643ab1e => generated 354 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 20:06:48.522252 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-5a8f9bbe-4f47-4bc3-8a26-477b6d00dd2c tempest-VolumesGetTestJSON-1669530346 tempest-VolumesGetTestJSON-1669530346-project] Calling method '.version_select at 0x7f351ce14820>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:06:48.778588 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-5a8f9bbe-4f47-4bc3-8a26-477b6d00dd2c tempest-VolumesGetTestJSON-1669530346 tempest-VolumesGetTestJSON-1669530346-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/9fa52160-d78d-4999-9404-b3e82643ab1e" status: 202 len: 0 microversion: 2.1 time: 0.260624 Jul 21 20:06:48.779294 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 152/326] 10.222.0.58 () {58 vars in 1247 bytes} [Thu Jul 21 20:06:48 2022] DELETE /compute/v2.1/os-volumes/9fa52160-d78d-4999-9404-b3e82643ab1e => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 20:06:48.787989 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-80b27750-0cee-44e6-8702-66a3c80fe05f tempest-VolumesGetTestJSON-1669530346 tempest-VolumesGetTestJSON-1669530346-project] Calling method '.version_select at 0x7f351cec5280>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:06:48.837663 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-80b27750-0cee-44e6-8702-66a3c80fe05f tempest-VolumesGetTestJSON-1669530346 tempest-VolumesGetTestJSON-1669530346-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/9fa52160-d78d-4999-9404-b3e82643ab1e" status: 200 len: 353 microversion: 2.1 time: 0.053459 Jul 21 20:06:48.838265 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 175/327] 10.222.0.58 () {58 vars in 1244 bytes} [Thu Jul 21 20:06:48 2022] GET /compute/v2.1/os-volumes/9fa52160-d78d-4999-9404-b3e82643ab1e => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:06:49.275669 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-565cfac0-b7d2-476d-9e54-0cf50a28f7fc tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:06:49.276270 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-565cfac0-b7d2-476d-9e54-0cf50a28f7fc tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 514a7771-fbf2-46db-9e3d-905a6a3e703d] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:06:49.278353 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG dbcounter [-] [118344] Writing DB stats nova_api:SELECT=40 {{(pid=118344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:06:49.283935 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-565cfac0-b7d2-476d-9e54-0cf50a28f7fc tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:49.285032 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-565cfac0-b7d2-476d-9e54-0cf50a28f7fc tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:49.285887 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-565cfac0-b7d2-476d-9e54-0cf50a28f7fc tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:49.286323 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-565cfac0-b7d2-476d-9e54-0cf50a28f7fc tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:49.420969 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-565cfac0-b7d2-476d-9e54-0cf50a28f7fc tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:06:49.428950 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-565cfac0-b7d2-476d-9e54-0cf50a28f7fc tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d" status: 200 len: 1521 microversion: 2.1 time: 0.157258 Jul 21 20:06:49.429513 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 153/328] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:06:49 2022] GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:06:49.851150 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-2e114936-a855-4e7b-86ce-25ab495e0aac tempest-VolumesGetTestJSON-1669530346 tempest-VolumesGetTestJSON-1669530346-project] Calling method '.version_select at 0x7f351d0efd30>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:06:49.879576 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.wsgi [None req-2e114936-a855-4e7b-86ce-25ab495e0aac tempest-VolumesGetTestJSON-1669530346 tempest-VolumesGetTestJSON-1669530346-project] HTTP exception thrown: Volume 9fa52160-d78d-4999-9404-b3e82643ab1e could not be found. Jul 21 20:06:49.881506 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-2e114936-a855-4e7b-86ce-25ab495e0aac tempest-VolumesGetTestJSON-1669530346 tempest-VolumesGetTestJSON-1669530346-project] Request method failure captured: Jul 21 20:06:49.881506 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: request: GET /compute/v2.1/os-volumes/9fa52160-d78d-4999-9404-b3e82643ab1e HTTP/1.1 Jul 21 20:06:49.881506 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Accept: application/json Jul 21 20:06:49.881506 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Accept-Encoding: identity Jul 21 20:06:49.881506 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Connection: close Jul 21 20:06:49.881506 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Content-Length: 0 Jul 21 20:06:49.881506 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Content-Type: application/json Jul 21 20:06:49.881506 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Host: 10.222.0.58 Jul 21 20:06:49.881506 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Openstack-System-Scope: None Jul 21 20:06:49.881506 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: User-Agent: python-urllib3/1.26.9 Jul 21 20:06:49.881506 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Auth-Token: gAAAAABi2bHSV7AcHqGd56zl2EFI6dc931pK3T94BEe7RQmjFMDCiyWlBbFAJpQTmzeJyThgmB8ubszEUt8_23woyiohytf8JoHhIHV3LNnNHORmWhCPaL9j-zYDWVhuxt5giyeDJ3D-r2h3YkhibKFgvXK6cDts1eVaiiXPBjujhIxbjtYeUM8 Jul 21 20:06:49.881506 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Domain-Id: None Jul 21 20:06:49.881506 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Domain-Name: None Jul 21 20:06:49.881506 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Identity-Status: Confirmed Jul 21 20:06:49.881506 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Is-Admin-Project: True Jul 21 20:06:49.881506 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Id: default Jul 21 20:06:49.881506 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Name: Default Jul 21 20:06:49.881506 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Id: 5bce5f14ef354bd5bc2c24e6b14e37c8 Jul 21 20:06:49.881506 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Name: tempest-VolumesGetTestJSON-1669530346 Jul 21 20:06:49.881506 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Role: reader,member Jul 21 20:06:49.881506 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Roles: reader,member Jul 21 20:06:49.882712 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5bce5f14ef354bd5bc2c24e6b14e37c8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5bce5f14ef354bd5bc2c24e6b14e37c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5bce5f14ef354bd5bc2c24e6b14e37c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5bce5f14ef354bd5bc2c24e6b14e37c8"}]}] Jul 21 20:06:49.882712 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Tenant: tempest-VolumesGetTestJSON-1669530346 Jul 21 20:06:49.882712 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Tenant-Id: 5bce5f14ef354bd5bc2c24e6b14e37c8 Jul 21 20:06:49.882712 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Tenant-Name: tempest-VolumesGetTestJSON-1669530346 Jul 21 20:06:49.882712 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User: tempest-VolumesGetTestJSON-1669530346-project Jul 21 20:06:49.882712 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Id: default Jul 21 20:06:49.882712 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Name: Default Jul 21 20:06:49.882712 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Id: 7d8e93195f9a455f8c7b97a46771f8e8 Jul 21 20:06:49.882712 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Name: tempest-VolumesGetTestJSON-1669530346-project Jul 21 20:06:49.882712 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: method: Jul 21 20:06:49.882712 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: exception: Volume 9fa52160-d78d-4999-9404-b3e82643ab1e could not be found. Jul 21 20:06:49.882712 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: action_args: {'id': '9fa52160-d78d-4999-9404-b3e82643ab1e'} Jul 21 20:06:49.882712 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 20:06:49.884298 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:06:49.884298 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 20:06:49.884298 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 20:06:49.884298 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 21 20:06:49.884298 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 21 20:06:49.884298 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 21 20:06:49.884298 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 21 20:06:49.884298 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 20:06:49.884298 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 20:06:49.884298 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 20:06:49.884298 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 20:06:49.884298 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 20:06:49.884298 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 20:06:49.884298 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 20:06:49.884298 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 20:06:49.884298 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9fa52160-d78d-4999-9404-b3e82643ab1e could not be found. (HTTP 404) (Request-ID: req-d5f77f4d-b9a6-4bb3-bdeb-7fc4c6f72c26) Jul 21 20:06:49.884298 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:06:49.884298 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:06:49.884298 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:06:49.885729 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:06:49.885729 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 21 20:06:49.885729 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 21 20:06:49.885729 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 20:06:49.885729 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 20:06:49.885729 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 21 20:06:49.885729 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 21 20:06:49.885729 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 20:06:49.885729 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 20:06:49.885729 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 20:06:49.885729 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 20:06:49.885729 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 21 20:06:49.885729 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 21 20:06:49.885729 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 21 20:06:49.885729 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 21 20:06:49.885729 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 20:06:49.885729 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 20:06:49.885729 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 20:06:49.885729 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 20:06:49.887075 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 20:06:49.887075 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 20:06:49.887075 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 20:06:49.887075 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 20:06:49.887075 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9fa52160-d78d-4999-9404-b3e82643ab1e could not be found. Jul 21 20:06:49.887075 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:06:49.887075 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:06:49.887075 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:06:49.887075 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:06:49.887075 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:06:49.887075 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:06:49.887075 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 20:06:49.887075 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 20:06:49.887075 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 20:06:49.887075 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 20:06:49.887075 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 20:06:49.887075 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 20:06:49.887075 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 21 20:06:49.887075 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 20:06:49.888364 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9fa52160-d78d-4999-9404-b3e82643ab1e could not be found. Jul 21 20:06:49.888364 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:06:49.888364 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:06:49.888364 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:06:49.888364 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:06:49.888364 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:06:49.888364 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:06:49.888364 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 20:06:49.888364 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 20:06:49.888364 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9fa52160-d78d-4999-9404-b3e82643ab1e could not be found. Jul 21 20:06:49.888364 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:06:49.888364 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-2e114936-a855-4e7b-86ce-25ab495e0aac tempest-VolumesGetTestJSON-1669530346 tempest-VolumesGetTestJSON-1669530346-project] Returning 404 to user: Volume 9fa52160-d78d-4999-9404-b3e82643ab1e could not be found. {{(pid=118345) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 20:06:49.888364 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-2e114936-a855-4e7b-86ce-25ab495e0aac tempest-VolumesGetTestJSON-1669530346 tempest-VolumesGetTestJSON-1669530346-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/9fa52160-d78d-4999-9404-b3e82643ab1e" status: 404 len: 109 microversion: 2.1 time: 0.036999 Jul 21 20:06:49.888364 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 176/329] 10.222.0.58 () {58 vars in 1244 bytes} [Thu Jul 21 20:06:49 2022] GET /compute/v2.1/os-volumes/9fa52160-d78d-4999-9404-b3e82643ab1e => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 20:06:50.446115 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-adec00c0-1a16-4e28-89e6-a1c4d18c532c tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:06:50.446786 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-adec00c0-1a16-4e28-89e6-a1c4d18c532c tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 514a7771-fbf2-46db-9e3d-905a6a3e703d] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:06:50.453500 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-adec00c0-1a16-4e28-89e6-a1c4d18c532c tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:50.453936 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-adec00c0-1a16-4e28-89e6-a1c4d18c532c tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:50.454734 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-adec00c0-1a16-4e28-89e6-a1c4d18c532c tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:50.455157 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-adec00c0-1a16-4e28-89e6-a1c4d18c532c tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:50.598215 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-adec00c0-1a16-4e28-89e6-a1c4d18c532c tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:06:50.605653 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-adec00c0-1a16-4e28-89e6-a1c4d18c532c tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d" status: 200 len: 1521 microversion: 2.1 time: 0.163967 Jul 21 20:06:50.606274 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 154/330] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:06:50 2022] GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:06:51.623815 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-df6270e0-c5da-40fe-bacf-dfea599458b6 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:06:51.624806 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-df6270e0-c5da-40fe-bacf-dfea599458b6 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 514a7771-fbf2-46db-9e3d-905a6a3e703d] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:06:51.631209 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-df6270e0-c5da-40fe-bacf-dfea599458b6 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:51.631655 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-df6270e0-c5da-40fe-bacf-dfea599458b6 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:51.632442 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-df6270e0-c5da-40fe-bacf-dfea599458b6 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:51.632871 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-df6270e0-c5da-40fe-bacf-dfea599458b6 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:51.781631 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-df6270e0-c5da-40fe-bacf-dfea599458b6 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:06:51.791504 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-df6270e0-c5da-40fe-bacf-dfea599458b6 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d" status: 200 len: 1521 microversion: 2.1 time: 0.172843 Jul 21 20:06:51.792008 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 177/331] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:06:51 2022] GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:06:52.639421 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-3ecfc0b7-4574-44be-82a8-dc3d4a112e49 tempest-VolumesNegativeTest-1689168791 tempest-VolumesNegativeTest-1689168791-project] Action: 'create', calling method: .version_select at 0x7f351d0bdf70>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-42483580", "metadata": {"Type": "work"}}} {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:06:52.662053 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-3ecfc0b7-4574-44be-82a8-dc3d4a112e49 tempest-VolumesNegativeTest-1689168791 tempest-VolumesNegativeTest-1689168791-project] Request method failure captured: Jul 21 20:06:52.662053 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 21 20:06:52.662053 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Accept: application/json Jul 21 20:06:52.662053 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Accept-Encoding: identity Jul 21 20:06:52.662053 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Connection: close Jul 21 20:06:52.662053 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Content-Length: 120 Jul 21 20:06:52.662053 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Content-Type: application/json Jul 21 20:06:52.662053 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Host: 10.222.0.58 Jul 21 20:06:52.662053 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Openstack-System-Scope: None Jul 21 20:06:52.662053 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: User-Agent: python-urllib3/1.26.9 Jul 21 20:06:52.662053 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Auth-Token: gAAAAABi2bHcHop1Yjm-chLeIq-BzLoCaBojzcrV2vnKzF5hYF_UIO0XXBoZFkKeDwOtY5l75Wbke03ClQYyq4Xg0jOBQeItODmby9W1Bbpci4msAZPaIRxGM-aeqRYa3B2MyzyPQiDbJsRge3u9NksW3XPHL4FxomJAXtD19v0Mu0ybqOKqFd4 Jul 21 20:06:52.662053 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Domain-Id: None Jul 21 20:06:52.662053 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Domain-Name: None Jul 21 20:06:52.662053 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Identity-Status: Confirmed Jul 21 20:06:52.662053 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Is-Admin-Project: True Jul 21 20:06:52.662053 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Domain-Id: default Jul 21 20:06:52.662053 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Domain-Name: Default Jul 21 20:06:52.662053 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Id: b34a204d77dc442b913aa78698aab5e5 Jul 21 20:06:52.662053 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Name: tempest-VolumesNegativeTest-1689168791 Jul 21 20:06:52.662053 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Role: reader,member Jul 21 20:06:52.662053 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Roles: reader,member Jul 21 20:06:52.663792 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b34a204d77dc442b913aa78698aab5e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b34a204d77dc442b913aa78698aab5e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b34a204d77dc442b913aa78698aab5e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b34a204d77dc442b913aa78698aab5e5"}]}] Jul 21 20:06:52.663792 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Tenant: tempest-VolumesNegativeTest-1689168791 Jul 21 20:06:52.663792 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Tenant-Id: b34a204d77dc442b913aa78698aab5e5 Jul 21 20:06:52.663792 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Tenant-Name: tempest-VolumesNegativeTest-1689168791 Jul 21 20:06:52.663792 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User: tempest-VolumesNegativeTest-1689168791-project Jul 21 20:06:52.663792 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Domain-Id: default Jul 21 20:06:52.663792 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Domain-Name: Default Jul 21 20:06:52.663792 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Id: 412332efa1494f328f8698b3eb8bdee1 Jul 21 20:06:52.663792 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Name: tempest-VolumesNegativeTest-1689168791-project Jul 21 20:06:52.663792 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Jul 21 20:06:52.663792 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-42483580", "metadata": {"Type": "work"}}} Jul 21 20:06:52.663792 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: method: Jul 21 20:06:52.663792 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 21 20:06:52.664745 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-42483580', 'metadata': {'Type': 'work'}}}} Jul 21 20:06:52.664745 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 20:06:52.664745 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:06:52.664745 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 21 20:06:52.664745 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 21 20:06:52.664745 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 21 20:06:52.664745 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi raise error Jul 21 20:06:52.664745 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 21 20:06:52.664745 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:06:52.664745 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 21 20:06:52.664745 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 21 20:06:52.664745 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:06:52.664745 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 21 20:06:52.664745 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi '#$%' Jul 21 20:06:52.664745 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:06:52.664745 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:06:52.664745 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:06:52.664745 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:06:52.664745 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:06:52.664745 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:06:52.664745 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 20:06:52.664745 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 20:06:52.666359 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 20:06:52.666359 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 20:06:52.666359 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 20:06:52.666359 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 20:06:52.666359 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 21 20:06:52.666359 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 21 20:06:52.666359 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 21 20:06:52.666359 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 21 20:06:52.666359 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 21 20:06:52.666359 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 21 20:06:52.666359 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 21 20:06:52.666359 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:06:52.666359 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:06:52.666359 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:06:52.666359 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:06:52.666359 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:06:52.666359 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:06:52.666359 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 21 20:06:52.666359 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 21 20:06:52.667609 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 21 20:06:52.667609 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:06:52.667609 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-3ecfc0b7-4574-44be-82a8-dc3d4a112e49 tempest-VolumesNegativeTest-1689168791 tempest-VolumesNegativeTest-1689168791-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 20:06:52.667609 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-3ecfc0b7-4574-44be-82a8-dc3d4a112e49 tempest-VolumesNegativeTest-1689168791 tempest-VolumesNegativeTest-1689168791-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.149874 Jul 21 20:06:52.667609 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 155/332] 10.222.0.58 () {60 vars in 1155 bytes} [Thu Jul 21 20:06:52 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 153 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 21 20:06:52.675930 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-16c3d43a-841f-42fa-afed-e5e692ab365d tempest-VolumesNegativeTest-1689168791 tempest-VolumesNegativeTest-1689168791-project] Action: 'create', calling method: .version_select at 0x7f351cec59d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-830064943", "metadata": {"Type": "work"}}} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:06:52.679686 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-16c3d43a-841f-42fa-afed-e5e692ab365d tempest-VolumesNegativeTest-1689168791 tempest-VolumesNegativeTest-1689168791-project] Request method failure captured: Jul 21 20:06:52.679686 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 21 20:06:52.679686 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Accept: application/json Jul 21 20:06:52.679686 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Accept-Encoding: identity Jul 21 20:06:52.679686 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Connection: close Jul 21 20:06:52.679686 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Content-Length: 119 Jul 21 20:06:52.679686 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Content-Type: application/json Jul 21 20:06:52.679686 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Host: 10.222.0.58 Jul 21 20:06:52.679686 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Openstack-System-Scope: None Jul 21 20:06:52.679686 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: User-Agent: python-urllib3/1.26.9 Jul 21 20:06:52.679686 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Auth-Token: gAAAAABi2bHcHop1Yjm-chLeIq-BzLoCaBojzcrV2vnKzF5hYF_UIO0XXBoZFkKeDwOtY5l75Wbke03ClQYyq4Xg0jOBQeItODmby9W1Bbpci4msAZPaIRxGM-aeqRYa3B2MyzyPQiDbJsRge3u9NksW3XPHL4FxomJAXtD19v0Mu0ybqOKqFd4 Jul 21 20:06:52.679686 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Domain-Id: None Jul 21 20:06:52.679686 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Domain-Name: None Jul 21 20:06:52.679686 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Identity-Status: Confirmed Jul 21 20:06:52.679686 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Is-Admin-Project: True Jul 21 20:06:52.679686 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Id: default Jul 21 20:06:52.679686 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Name: Default Jul 21 20:06:52.679686 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Id: b34a204d77dc442b913aa78698aab5e5 Jul 21 20:06:52.679686 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Name: tempest-VolumesNegativeTest-1689168791 Jul 21 20:06:52.679686 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Role: reader,member Jul 21 20:06:52.679686 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Roles: reader,member Jul 21 20:06:52.681115 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b34a204d77dc442b913aa78698aab5e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b34a204d77dc442b913aa78698aab5e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b34a204d77dc442b913aa78698aab5e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b34a204d77dc442b913aa78698aab5e5"}]}] Jul 21 20:06:52.681115 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Tenant: tempest-VolumesNegativeTest-1689168791 Jul 21 20:06:52.681115 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Tenant-Id: b34a204d77dc442b913aa78698aab5e5 Jul 21 20:06:52.681115 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Tenant-Name: tempest-VolumesNegativeTest-1689168791 Jul 21 20:06:52.681115 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User: tempest-VolumesNegativeTest-1689168791-project Jul 21 20:06:52.681115 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Id: default Jul 21 20:06:52.681115 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Name: Default Jul 21 20:06:52.681115 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Id: 412332efa1494f328f8698b3eb8bdee1 Jul 21 20:06:52.681115 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Name: tempest-VolumesNegativeTest-1689168791-project Jul 21 20:06:52.681115 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Jul 21 20:06:52.681115 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-830064943", "metadata": {"Type": "work"}}} Jul 21 20:06:52.681115 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: method: Jul 21 20:06:52.681115 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 21 20:06:52.681971 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-830064943', 'metadata': {'Type': 'work'}}}} Jul 21 20:06:52.681971 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 20:06:52.681971 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:06:52.681971 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 21 20:06:52.681971 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 21 20:06:52.681971 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 21 20:06:52.681971 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise error Jul 21 20:06:52.681971 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 21 20:06:52.681971 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:06:52.681971 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 21 20:06:52.681971 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 21 20:06:52.681971 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:06:52.681971 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 21 20:06:52.681971 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi '0' Jul 21 20:06:52.681971 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:06:52.681971 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:06:52.681971 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:06:52.681971 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:06:52.681971 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:06:52.681971 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:06:52.681971 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 20:06:52.681971 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 20:06:52.683477 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 20:06:52.683477 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 20:06:52.683477 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 20:06:52.683477 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 20:06:52.683477 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 21 20:06:52.683477 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 21 20:06:52.683477 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 21 20:06:52.683477 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 21 20:06:52.683477 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 21 20:06:52.683477 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 21 20:06:52.683477 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 21 20:06:52.683477 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:06:52.683477 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:06:52.683477 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:06:52.683477 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:06:52.683477 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:06:52.683477 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:06:52.683477 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 21 20:06:52.683477 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 21 20:06:52.684668 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 21 20:06:52.684668 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:06:52.684668 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-16c3d43a-841f-42fa-afed-e5e692ab365d tempest-VolumesNegativeTest-1689168791 tempest-VolumesNegativeTest-1689168791-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118345) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 20:06:52.684668 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-16c3d43a-841f-42fa-afed-e5e692ab365d tempest-VolumesNegativeTest-1689168791 tempest-VolumesNegativeTest-1689168791-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009562 Jul 21 20:06:52.684668 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 178/333] 10.222.0.58 () {60 vars in 1155 bytes} [Thu Jul 21 20:06:52 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 21 20:06:52.690003 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-0b8f9314-4e14-4b9d-8504-95eeb82d86bd tempest-VolumesNegativeTest-1689168791 tempest-VolumesNegativeTest-1689168791-project] Action: 'create', calling method: .version_select at 0x7f351ce2d040>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-6566148", "metadata": {"Type": "work"}}} {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:06:52.692380 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-0b8f9314-4e14-4b9d-8504-95eeb82d86bd tempest-VolumesNegativeTest-1689168791 tempest-VolumesNegativeTest-1689168791-project] Request method failure captured: Jul 21 20:06:52.692380 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 21 20:06:52.692380 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Accept: application/json Jul 21 20:06:52.692380 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Accept-Encoding: identity Jul 21 20:06:52.692380 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Connection: close Jul 21 20:06:52.692380 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Content-Length: 116 Jul 21 20:06:52.692380 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Content-Type: application/json Jul 21 20:06:52.692380 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Host: 10.222.0.58 Jul 21 20:06:52.692380 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Openstack-System-Scope: None Jul 21 20:06:52.692380 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: User-Agent: python-urllib3/1.26.9 Jul 21 20:06:52.692380 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Auth-Token: gAAAAABi2bHcHop1Yjm-chLeIq-BzLoCaBojzcrV2vnKzF5hYF_UIO0XXBoZFkKeDwOtY5l75Wbke03ClQYyq4Xg0jOBQeItODmby9W1Bbpci4msAZPaIRxGM-aeqRYa3B2MyzyPQiDbJsRge3u9NksW3XPHL4FxomJAXtD19v0Mu0ybqOKqFd4 Jul 21 20:06:52.692380 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Domain-Id: None Jul 21 20:06:52.692380 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Domain-Name: None Jul 21 20:06:52.692380 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Identity-Status: Confirmed Jul 21 20:06:52.692380 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Is-Admin-Project: True Jul 21 20:06:52.692380 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Domain-Id: default Jul 21 20:06:52.692380 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Domain-Name: Default Jul 21 20:06:52.692380 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Id: b34a204d77dc442b913aa78698aab5e5 Jul 21 20:06:52.692380 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Name: tempest-VolumesNegativeTest-1689168791 Jul 21 20:06:52.692380 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Role: reader,member Jul 21 20:06:52.692380 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Roles: reader,member Jul 21 20:06:52.693747 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b34a204d77dc442b913aa78698aab5e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b34a204d77dc442b913aa78698aab5e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b34a204d77dc442b913aa78698aab5e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b34a204d77dc442b913aa78698aab5e5"}]}] Jul 21 20:06:52.693747 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Tenant: tempest-VolumesNegativeTest-1689168791 Jul 21 20:06:52.693747 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Tenant-Id: b34a204d77dc442b913aa78698aab5e5 Jul 21 20:06:52.693747 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Tenant-Name: tempest-VolumesNegativeTest-1689168791 Jul 21 20:06:52.693747 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User: tempest-VolumesNegativeTest-1689168791-project Jul 21 20:06:52.693747 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Domain-Id: default Jul 21 20:06:52.693747 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Domain-Name: Default Jul 21 20:06:52.693747 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Id: 412332efa1494f328f8698b3eb8bdee1 Jul 21 20:06:52.693747 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Name: tempest-VolumesNegativeTest-1689168791-project Jul 21 20:06:52.693747 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Jul 21 20:06:52.693747 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-6566148", "metadata": {"Type": "work"}}} Jul 21 20:06:52.693747 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: method: Jul 21 20:06:52.693747 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 21 20:06:52.694578 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-6566148', 'metadata': {'Type': 'work'}}}} Jul 21 20:06:52.694578 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 20:06:52.694578 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:06:52.694578 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 21 20:06:52.694578 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 21 20:06:52.694578 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 21 20:06:52.694578 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi raise error Jul 21 20:06:52.694578 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 21 20:06:52.694578 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:06:52.694578 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 21 20:06:52.694578 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 21 20:06:52.694578 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:06:52.694578 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 21 20:06:52.694578 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi '' Jul 21 20:06:52.694578 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:06:52.694578 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:06:52.694578 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:06:52.694578 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:06:52.694578 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:06:52.694578 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:06:52.694578 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 20:06:52.694578 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 20:06:52.695991 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 20:06:52.695991 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 20:06:52.695991 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 20:06:52.695991 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 20:06:52.695991 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 21 20:06:52.695991 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 21 20:06:52.695991 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 21 20:06:52.695991 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 21 20:06:52.695991 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 21 20:06:52.695991 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 21 20:06:52.695991 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 21 20:06:52.695991 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:06:52.695991 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:06:52.695991 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:06:52.695991 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:06:52.695991 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:06:52.695991 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:06:52.695991 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 21 20:06:52.695991 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 21 20:06:52.697081 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 21 20:06:52.697081 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:06:52.697081 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-0b8f9314-4e14-4b9d-8504-95eeb82d86bd tempest-VolumesNegativeTest-1689168791 tempest-VolumesNegativeTest-1689168791-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 20:06:52.697081 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-0b8f9314-4e14-4b9d-8504-95eeb82d86bd tempest-VolumesNegativeTest-1689168791 tempest-VolumesNegativeTest-1689168791-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007866 Jul 21 20:06:52.697081 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 156/334] 10.222.0.58 () {60 vars in 1155 bytes} [Thu Jul 21 20:06:52 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 21 20:06:52.702602 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-c02853a6-bc6c-4541-bb2c-1fe2c9f1991e tempest-VolumesNegativeTest-1689168791 tempest-VolumesNegativeTest-1689168791-project] Calling method '.version_select at 0x7f351cf81c10>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:06:52.733883 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.wsgi [None req-c02853a6-bc6c-4541-bb2c-1fe2c9f1991e tempest-VolumesNegativeTest-1689168791 tempest-VolumesNegativeTest-1689168791-project] HTTP exception thrown: Volume tempest-invalid-389787082 could not be found. Jul 21 20:06:52.736071 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-c02853a6-bc6c-4541-bb2c-1fe2c9f1991e tempest-VolumesNegativeTest-1689168791 tempest-VolumesNegativeTest-1689168791-project] Request method failure captured: Jul 21 20:06:52.736071 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-389787082 HTTP/1.1 Jul 21 20:06:52.736071 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Accept: application/json Jul 21 20:06:52.736071 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Accept-Encoding: identity Jul 21 20:06:52.736071 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Connection: close Jul 21 20:06:52.736071 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Content-Length: 0 Jul 21 20:06:52.736071 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Content-Type: application/json Jul 21 20:06:52.736071 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Host: 10.222.0.58 Jul 21 20:06:52.736071 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Openstack-System-Scope: None Jul 21 20:06:52.736071 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: User-Agent: python-urllib3/1.26.9 Jul 21 20:06:52.736071 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Auth-Token: gAAAAABi2bHcHop1Yjm-chLeIq-BzLoCaBojzcrV2vnKzF5hYF_UIO0XXBoZFkKeDwOtY5l75Wbke03ClQYyq4Xg0jOBQeItODmby9W1Bbpci4msAZPaIRxGM-aeqRYa3B2MyzyPQiDbJsRge3u9NksW3XPHL4FxomJAXtD19v0Mu0ybqOKqFd4 Jul 21 20:06:52.736071 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Domain-Id: None Jul 21 20:06:52.736071 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Domain-Name: None Jul 21 20:06:52.736071 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Identity-Status: Confirmed Jul 21 20:06:52.736071 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Is-Admin-Project: True Jul 21 20:06:52.736071 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Id: default Jul 21 20:06:52.736071 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Name: Default Jul 21 20:06:52.736071 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Id: b34a204d77dc442b913aa78698aab5e5 Jul 21 20:06:52.736071 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Name: tempest-VolumesNegativeTest-1689168791 Jul 21 20:06:52.736071 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Role: reader,member Jul 21 20:06:52.736071 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Roles: reader,member Jul 21 20:06:52.737519 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b34a204d77dc442b913aa78698aab5e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b34a204d77dc442b913aa78698aab5e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b34a204d77dc442b913aa78698aab5e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b34a204d77dc442b913aa78698aab5e5"}]}] Jul 21 20:06:52.737519 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Tenant: tempest-VolumesNegativeTest-1689168791 Jul 21 20:06:52.737519 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Tenant-Id: b34a204d77dc442b913aa78698aab5e5 Jul 21 20:06:52.737519 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Tenant-Name: tempest-VolumesNegativeTest-1689168791 Jul 21 20:06:52.737519 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User: tempest-VolumesNegativeTest-1689168791-project Jul 21 20:06:52.737519 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Id: default Jul 21 20:06:52.737519 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Name: Default Jul 21 20:06:52.737519 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Id: 412332efa1494f328f8698b3eb8bdee1 Jul 21 20:06:52.737519 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Name: tempest-VolumesNegativeTest-1689168791-project Jul 21 20:06:52.737519 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: method: Jul 21 20:06:52.737519 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: exception: Volume tempest-invalid-389787082 could not be found. Jul 21 20:06:52.737519 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: action_args: {'id': 'tempest-invalid-389787082'} Jul 21 20:06:52.737519 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 20:06:52.738597 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:06:52.738597 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 20:06:52.738597 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 20:06:52.738597 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 21 20:06:52.738597 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 21 20:06:52.738597 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 21 20:06:52.738597 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 21 20:06:52.738597 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 21 20:06:52.738597 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 21 20:06:52.738597 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 21 20:06:52.738597 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 21 20:06:52.738597 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 20:06:52.738597 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 20:06:52.738597 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 20:06:52.738597 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 20:06:52.738597 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-389787082 could not be found. (HTTP 404) (Request-ID: req-0478ebdc-b17d-484b-9336-f4b95526f429) Jul 21 20:06:52.738597 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:06:52.738597 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:06:52.738597 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:06:52.739985 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:06:52.739985 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 21 20:06:52.739985 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 21 20:06:52.739985 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 20:06:52.739985 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 20:06:52.739985 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 21 20:06:52.739985 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 21 20:06:52.739985 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 20:06:52.739985 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 20:06:52.739985 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 20:06:52.739985 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 20:06:52.739985 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 21 20:06:52.739985 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 21 20:06:52.739985 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 21 20:06:52.739985 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 21 20:06:52.739985 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 21 20:06:52.739985 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 21 20:06:52.739985 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 21 20:06:52.739985 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 21 20:06:52.741286 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 20:06:52.741286 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 20:06:52.741286 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 20:06:52.741286 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 20:06:52.741286 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-389787082 could not be found. Jul 21 20:06:52.741286 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:06:52.741286 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:06:52.741286 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:06:52.741286 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:06:52.741286 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:06:52.741286 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:06:52.741286 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 20:06:52.741286 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 20:06:52.741286 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 20:06:52.741286 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 20:06:52.741286 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 20:06:52.741286 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 20:06:52.741286 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 21 20:06:52.741286 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 20:06:52.741286 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-389787082 could not be found. Jul 21 20:06:52.743570 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:06:52.743570 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:06:52.743570 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:06:52.743570 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:06:52.743570 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:06:52.743570 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:06:52.743570 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 20:06:52.743570 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 20:06:52.743570 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-389787082 could not be found. Jul 21 20:06:52.743570 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:06:52.743570 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-c02853a6-bc6c-4541-bb2c-1fe2c9f1991e tempest-VolumesNegativeTest-1689168791 tempest-VolumesNegativeTest-1689168791-project] Returning 404 to user: Volume tempest-invalid-389787082 could not be found. {{(pid=118345) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 20:06:52.743570 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-c02853a6-bc6c-4541-bb2c-1fe2c9f1991e tempest-VolumesNegativeTest-1689168791 tempest-VolumesNegativeTest-1689168791-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/tempest-invalid-389787082" status: 404 len: 98 microversion: 2.1 time: 0.040177 Jul 21 20:06:52.744566 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 179/335] 10.222.0.58 () {58 vars in 1214 bytes} [Thu Jul 21 20:06:52 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-389787082 => generated 98 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 21 20:06:52.750380 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-eca6685f-4875-4454-9169-3b9b29d27eaa tempest-VolumesNegativeTest-1689168791 tempest-VolumesNegativeTest-1689168791-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004139 Jul 21 20:06:52.755374 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 157/336] 10.222.0.58 () {58 vars in 1139 bytes} [Thu Jul 21 20:06:52 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 21 20:06:52.760502 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-c4c19b7c-7fda-4838-a06e-72524cc06be0 tempest-VolumesNegativeTest-1689168791 tempest-VolumesNegativeTest-1689168791-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003863 Jul 21 20:06:52.760991 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 180/337] 10.222.0.58 () {58 vars in 1136 bytes} [Thu Jul 21 20:06:52 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 21 20:06:52.770511 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-f1155959-6700-4425-acef-05fdaa10bba5 tempest-VolumesNegativeTest-1689168791 tempest-VolumesNegativeTest-1689168791-project] Calling method '.version_select at 0x7f351cf17af0>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:06:52.799923 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.wsgi [None req-f1155959-6700-4425-acef-05fdaa10bba5 tempest-VolumesNegativeTest-1689168791 tempest-VolumesNegativeTest-1689168791-project] HTTP exception thrown: Volume 8b513da9-b234-4574-9f11-d1b61ac546a5 could not be found. Jul 21 20:06:52.802178 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-f1155959-6700-4425-acef-05fdaa10bba5 tempest-VolumesNegativeTest-1689168791 tempest-VolumesNegativeTest-1689168791-project] Request method failure captured: Jul 21 20:06:52.802178 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: request: DELETE /compute/v2.1/os-volumes/8b513da9-b234-4574-9f11-d1b61ac546a5 HTTP/1.1 Jul 21 20:06:52.802178 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Accept: application/json Jul 21 20:06:52.802178 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Accept-Encoding: identity Jul 21 20:06:52.802178 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Connection: close Jul 21 20:06:52.802178 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Content-Length: 0 Jul 21 20:06:52.802178 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Content-Type: application/json Jul 21 20:06:52.802178 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Host: 10.222.0.58 Jul 21 20:06:52.802178 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Openstack-System-Scope: None Jul 21 20:06:52.802178 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: User-Agent: python-urllib3/1.26.9 Jul 21 20:06:52.802178 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Auth-Token: gAAAAABi2bHcHop1Yjm-chLeIq-BzLoCaBojzcrV2vnKzF5hYF_UIO0XXBoZFkKeDwOtY5l75Wbke03ClQYyq4Xg0jOBQeItODmby9W1Bbpci4msAZPaIRxGM-aeqRYa3B2MyzyPQiDbJsRge3u9NksW3XPHL4FxomJAXtD19v0Mu0ybqOKqFd4 Jul 21 20:06:52.802178 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Domain-Id: None Jul 21 20:06:52.802178 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Domain-Name: None Jul 21 20:06:52.802178 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Identity-Status: Confirmed Jul 21 20:06:52.802178 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Is-Admin-Project: True Jul 21 20:06:52.802178 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Domain-Id: default Jul 21 20:06:52.802178 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Domain-Name: Default Jul 21 20:06:52.802178 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Id: b34a204d77dc442b913aa78698aab5e5 Jul 21 20:06:52.802178 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Name: tempest-VolumesNegativeTest-1689168791 Jul 21 20:06:52.802178 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Role: reader,member Jul 21 20:06:52.802178 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Roles: reader,member Jul 21 20:06:52.803591 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b34a204d77dc442b913aa78698aab5e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b34a204d77dc442b913aa78698aab5e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b34a204d77dc442b913aa78698aab5e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b34a204d77dc442b913aa78698aab5e5"}]}] Jul 21 20:06:52.803591 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Tenant: tempest-VolumesNegativeTest-1689168791 Jul 21 20:06:52.803591 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Tenant-Id: b34a204d77dc442b913aa78698aab5e5 Jul 21 20:06:52.803591 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Tenant-Name: tempest-VolumesNegativeTest-1689168791 Jul 21 20:06:52.803591 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User: tempest-VolumesNegativeTest-1689168791-project Jul 21 20:06:52.803591 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Domain-Id: default Jul 21 20:06:52.803591 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Domain-Name: Default Jul 21 20:06:52.803591 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Id: 412332efa1494f328f8698b3eb8bdee1 Jul 21 20:06:52.803591 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Name: tempest-VolumesNegativeTest-1689168791-project Jul 21 20:06:52.803591 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: method: Jul 21 20:06:52.803591 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: exception: Volume 8b513da9-b234-4574-9f11-d1b61ac546a5 could not be found. Jul 21 20:06:52.803591 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: action_args: {'id': '8b513da9-b234-4574-9f11-d1b61ac546a5'} Jul 21 20:06:52.803591 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 20:06:52.804415 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:06:52.804415 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 20:06:52.804415 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 20:06:52.804415 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 21 20:06:52.804415 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 21 20:06:52.804415 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 21 20:06:52.804415 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 21 20:06:52.804415 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 21 20:06:52.804415 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 21 20:06:52.804415 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 21 20:06:52.804415 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 21 20:06:52.804415 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 20:06:52.804415 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 20:06:52.804415 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 20:06:52.804415 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 20:06:52.804415 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8b513da9-b234-4574-9f11-d1b61ac546a5 could not be found. (HTTP 404) (Request-ID: req-9d6c5af7-f101-4c61-98c2-8df14fb13437) Jul 21 20:06:52.804415 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:06:52.804415 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:06:52.804415 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:06:52.805503 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:06:52.805503 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 21 20:06:52.805503 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 21 20:06:52.805503 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 20:06:52.805503 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 20:06:52.805503 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 21 20:06:52.805503 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 21 20:06:52.805503 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 20:06:52.805503 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 20:06:52.805503 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 20:06:52.805503 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 20:06:52.805503 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 21 20:06:52.805503 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 21 20:06:52.805503 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 21 20:06:52.805503 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 21 20:06:52.805503 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 21 20:06:52.805503 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 21 20:06:52.805503 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 21 20:06:52.805503 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 21 20:06:52.806694 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 20:06:52.806694 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 20:06:52.806694 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 20:06:52.806694 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 20:06:52.806694 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8b513da9-b234-4574-9f11-d1b61ac546a5 could not be found. Jul 21 20:06:52.806694 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:06:52.806694 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:06:52.806694 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:06:52.806694 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:06:52.806694 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:06:52.806694 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:06:52.806694 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 20:06:52.806694 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 20:06:52.806694 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 20:06:52.806694 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 20:06:52.806694 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 20:06:52.806694 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 20:06:52.806694 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 21 20:06:52.806694 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 20:06:52.808159 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8b513da9-b234-4574-9f11-d1b61ac546a5 could not be found. Jul 21 20:06:52.808159 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:06:52.808159 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:06:52.808159 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:06:52.808159 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:06:52.808159 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:06:52.808159 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:06:52.808159 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 20:06:52.808159 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 20:06:52.808159 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8b513da9-b234-4574-9f11-d1b61ac546a5 could not be found. Jul 21 20:06:52.808159 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:06:52.808159 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-f1155959-6700-4425-acef-05fdaa10bba5 tempest-VolumesNegativeTest-1689168791 tempest-VolumesNegativeTest-1689168791-project] Returning 404 to user: Volume 8b513da9-b234-4574-9f11-d1b61ac546a5 could not be found. {{(pid=118344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 20:06:52.808159 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-f1155959-6700-4425-acef-05fdaa10bba5 tempest-VolumesNegativeTest-1689168791 tempest-VolumesNegativeTest-1689168791-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/8b513da9-b234-4574-9f11-d1b61ac546a5" status: 404 len: 109 microversion: 2.1 time: 0.037762 Jul 21 20:06:52.808159 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 158/338] 10.222.0.58 () {58 vars in 1247 bytes} [Thu Jul 21 20:06:52 2022] DELETE /compute/v2.1/os-volumes/8b513da9-b234-4574-9f11-d1b61ac546a5 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 20:06:52.811707 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-f6bdb553-03cd-4e21-aba8-9cf187cfcbf8 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:06:52.812321 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-f6bdb553-03cd-4e21-aba8-9cf187cfcbf8 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 514a7771-fbf2-46db-9e3d-905a6a3e703d] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:06:52.814123 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-c32f0971-aa6e-4148-a711-b5db1f6ca010 tempest-VolumesNegativeTest-1689168791 tempest-VolumesNegativeTest-1689168791-project] Calling method '.version_select at 0x7f351ce2d8b0>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:06:52.819155 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f6bdb553-03cd-4e21-aba8-9cf187cfcbf8 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:52.819628 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f6bdb553-03cd-4e21-aba8-9cf187cfcbf8 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:52.820437 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f6bdb553-03cd-4e21-aba8-9cf187cfcbf8 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:52.820893 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f6bdb553-03cd-4e21-aba8-9cf187cfcbf8 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:52.846820 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.wsgi [None req-c32f0971-aa6e-4148-a711-b5db1f6ca010 tempest-VolumesNegativeTest-1689168791 tempest-VolumesNegativeTest-1689168791-project] HTTP exception thrown: Volume ddd349f4-9adf-4eb5-b38b-b53f6059091e could not be found. Jul 21 20:06:52.848789 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-c32f0971-aa6e-4148-a711-b5db1f6ca010 tempest-VolumesNegativeTest-1689168791 tempest-VolumesNegativeTest-1689168791-project] Request method failure captured: Jul 21 20:06:52.848789 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: request: GET /compute/v2.1/os-volumes/ddd349f4-9adf-4eb5-b38b-b53f6059091e HTTP/1.1 Jul 21 20:06:52.848789 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Accept: application/json Jul 21 20:06:52.848789 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Accept-Encoding: identity Jul 21 20:06:52.848789 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Connection: close Jul 21 20:06:52.848789 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Content-Length: 0 Jul 21 20:06:52.848789 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Content-Type: application/json Jul 21 20:06:52.848789 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Host: 10.222.0.58 Jul 21 20:06:52.848789 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Openstack-System-Scope: None Jul 21 20:06:52.848789 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: User-Agent: python-urllib3/1.26.9 Jul 21 20:06:52.848789 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Auth-Token: gAAAAABi2bHcHop1Yjm-chLeIq-BzLoCaBojzcrV2vnKzF5hYF_UIO0XXBoZFkKeDwOtY5l75Wbke03ClQYyq4Xg0jOBQeItODmby9W1Bbpci4msAZPaIRxGM-aeqRYa3B2MyzyPQiDbJsRge3u9NksW3XPHL4FxomJAXtD19v0Mu0ybqOKqFd4 Jul 21 20:06:52.848789 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Domain-Id: None Jul 21 20:06:52.848789 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Domain-Name: None Jul 21 20:06:52.848789 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Identity-Status: Confirmed Jul 21 20:06:52.848789 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Is-Admin-Project: True Jul 21 20:06:52.848789 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Domain-Id: default Jul 21 20:06:52.848789 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Domain-Name: Default Jul 21 20:06:52.848789 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Id: b34a204d77dc442b913aa78698aab5e5 Jul 21 20:06:52.848789 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Name: tempest-VolumesNegativeTest-1689168791 Jul 21 20:06:52.848789 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Role: reader,member Jul 21 20:06:52.848789 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Roles: reader,member Jul 21 20:06:52.850182 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b34a204d77dc442b913aa78698aab5e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b34a204d77dc442b913aa78698aab5e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b34a204d77dc442b913aa78698aab5e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b34a204d77dc442b913aa78698aab5e5"}]}] Jul 21 20:06:52.850182 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Tenant: tempest-VolumesNegativeTest-1689168791 Jul 21 20:06:52.850182 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Tenant-Id: b34a204d77dc442b913aa78698aab5e5 Jul 21 20:06:52.850182 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Tenant-Name: tempest-VolumesNegativeTest-1689168791 Jul 21 20:06:52.850182 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User: tempest-VolumesNegativeTest-1689168791-project Jul 21 20:06:52.850182 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Domain-Id: default Jul 21 20:06:52.850182 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Domain-Name: Default Jul 21 20:06:52.850182 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Id: 412332efa1494f328f8698b3eb8bdee1 Jul 21 20:06:52.850182 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Name: tempest-VolumesNegativeTest-1689168791-project Jul 21 20:06:52.850182 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: method: Jul 21 20:06:52.850182 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: exception: Volume ddd349f4-9adf-4eb5-b38b-b53f6059091e could not be found. Jul 21 20:06:52.850182 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: action_args: {'id': 'ddd349f4-9adf-4eb5-b38b-b53f6059091e'} Jul 21 20:06:52.850182 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 20:06:52.851183 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:06:52.851183 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 20:06:52.851183 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 20:06:52.851183 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 21 20:06:52.851183 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 21 20:06:52.851183 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 21 20:06:52.851183 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 21 20:06:52.851183 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 20:06:52.851183 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 20:06:52.851183 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 20:06:52.851183 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 20:06:52.851183 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 20:06:52.851183 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 20:06:52.851183 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 20:06:52.851183 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 20:06:52.851183 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ddd349f4-9adf-4eb5-b38b-b53f6059091e could not be found. (HTTP 404) (Request-ID: req-567a970e-6e0c-4414-b9bb-3bcd256341cb) Jul 21 20:06:52.851183 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:06:52.851183 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:06:52.851183 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:06:52.852408 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:06:52.852408 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 21 20:06:52.852408 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 21 20:06:52.852408 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 20:06:52.852408 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 20:06:52.852408 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 21 20:06:52.852408 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 21 20:06:52.852408 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 20:06:52.852408 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 20:06:52.852408 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 20:06:52.852408 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 20:06:52.852408 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 21 20:06:52.852408 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 21 20:06:52.852408 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 21 20:06:52.852408 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 21 20:06:52.852408 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 20:06:52.852408 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 20:06:52.852408 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 20:06:52.852408 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 20:06:52.854246 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 20:06:52.854246 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 20:06:52.854246 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 20:06:52.854246 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 20:06:52.854246 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ddd349f4-9adf-4eb5-b38b-b53f6059091e could not be found. Jul 21 20:06:52.854246 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:06:52.854246 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:06:52.854246 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:06:52.854246 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:06:52.854246 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:06:52.854246 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:06:52.854246 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 20:06:52.854246 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 20:06:52.854246 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 20:06:52.854246 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 20:06:52.854246 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 20:06:52.854246 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 20:06:52.854246 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 21 20:06:52.854246 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 20:06:52.855508 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ddd349f4-9adf-4eb5-b38b-b53f6059091e could not be found. Jul 21 20:06:52.855508 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:06:52.855508 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:06:52.855508 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:06:52.855508 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:06:52.855508 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:06:52.855508 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:06:52.855508 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 20:06:52.855508 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 20:06:52.855508 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ddd349f4-9adf-4eb5-b38b-b53f6059091e could not be found. Jul 21 20:06:52.855508 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:06:52.855508 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-c32f0971-aa6e-4148-a711-b5db1f6ca010 tempest-VolumesNegativeTest-1689168791 tempest-VolumesNegativeTest-1689168791-project] Returning 404 to user: Volume ddd349f4-9adf-4eb5-b38b-b53f6059091e could not be found. {{(pid=118344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 20:06:52.855508 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-c32f0971-aa6e-4148-a711-b5db1f6ca010 tempest-VolumesNegativeTest-1689168791 tempest-VolumesNegativeTest-1689168791-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/ddd349f4-9adf-4eb5-b38b-b53f6059091e" status: 404 len: 109 microversion: 2.1 time: 0.040142 Jul 21 20:06:52.855508 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 159/339] 10.222.0.58 () {58 vars in 1244 bytes} [Thu Jul 21 20:06:52 2022] GET /compute/v2.1/os-volumes/ddd349f4-9adf-4eb5-b38b-b53f6059091e => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 20:06:52.960189 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-f6bdb553-03cd-4e21-aba8-9cf187cfcbf8 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:06:52.968615 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-f6bdb553-03cd-4e21-aba8-9cf187cfcbf8 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d" status: 200 len: 1521 microversion: 2.1 time: 0.164301 Jul 21 20:06:52.969618 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 181/340] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:06:52 2022] GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:06:53.988133 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-3825240a-05ed-4078-9413-4347d8038ee6 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:06:53.988753 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-3825240a-05ed-4078-9413-4347d8038ee6 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 514a7771-fbf2-46db-9e3d-905a6a3e703d] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:06:53.994894 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-3825240a-05ed-4078-9413-4347d8038ee6 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:53.995366 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-3825240a-05ed-4078-9413-4347d8038ee6 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:53.996118 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-3825240a-05ed-4078-9413-4347d8038ee6 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:53.996543 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-3825240a-05ed-4078-9413-4347d8038ee6 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:54.147382 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-3825240a-05ed-4078-9413-4347d8038ee6 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:06:54.154809 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-3825240a-05ed-4078-9413-4347d8038ee6 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d" status: 200 len: 1521 microversion: 2.1 time: 0.171673 Jul 21 20:06:54.155425 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 160/341] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:06:53 2022] GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:06:55.171943 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-49309e5b-5529-49e5-b538-406827eaae6c tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:06:55.172476 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-49309e5b-5529-49e5-b538-406827eaae6c tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 514a7771-fbf2-46db-9e3d-905a6a3e703d] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:06:55.184182 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-49309e5b-5529-49e5-b538-406827eaae6c tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:55.184182 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-49309e5b-5529-49e5-b538-406827eaae6c tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:55.184182 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-49309e5b-5529-49e5-b538-406827eaae6c tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:55.184182 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-49309e5b-5529-49e5-b538-406827eaae6c tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:55.339824 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-49309e5b-5529-49e5-b538-406827eaae6c tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:06:55.348266 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-49309e5b-5529-49e5-b538-406827eaae6c tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d" status: 200 len: 1521 microversion: 2.1 time: 0.180240 Jul 21 20:06:55.348839 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 182/342] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:06:55 2022] GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:06:56.378437 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-46dab284-76e0-49b8-88ae-9d91f783ed4b tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:06:56.378437 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-46dab284-76e0-49b8-88ae-9d91f783ed4b tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 514a7771-fbf2-46db-9e3d-905a6a3e703d] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:06:56.383270 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-46dab284-76e0-49b8-88ae-9d91f783ed4b tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:56.383744 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-46dab284-76e0-49b8-88ae-9d91f783ed4b tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:56.384831 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-46dab284-76e0-49b8-88ae-9d91f783ed4b tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:56.384932 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-46dab284-76e0-49b8-88ae-9d91f783ed4b tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:56.676310 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-46dab284-76e0-49b8-88ae-9d91f783ed4b tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:06:56.686237 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-46dab284-76e0-49b8-88ae-9d91f783ed4b tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d" status: 200 len: 1521 microversion: 2.1 time: 0.314125 Jul 21 20:06:56.687383 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 161/343] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:06:56 2022] GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d => generated 1521 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:06:57.703969 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-17a739dd-ef4f-419c-8772-4ad1fd88efbf tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:06:57.704580 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-17a739dd-ef4f-419c-8772-4ad1fd88efbf tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 514a7771-fbf2-46db-9e3d-905a6a3e703d] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:06:57.711487 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-17a739dd-ef4f-419c-8772-4ad1fd88efbf tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:57.711882 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-17a739dd-ef4f-419c-8772-4ad1fd88efbf tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:57.712646 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-17a739dd-ef4f-419c-8772-4ad1fd88efbf tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:57.713140 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-17a739dd-ef4f-419c-8772-4ad1fd88efbf tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:57.718358 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell1:SELECT=100 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:06:57.850825 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-17a739dd-ef4f-419c-8772-4ad1fd88efbf tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:06:57.859007 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-17a739dd-ef4f-419c-8772-4ad1fd88efbf tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d" status: 200 len: 1521 microversion: 2.1 time: 0.158581 Jul 21 20:06:57.859940 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 183/344] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:06:57 2022] GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:06:58.876410 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-4b301b7b-a6d5-4d0c-b386-b76e88bf4ac4 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:06:58.877011 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-4b301b7b-a6d5-4d0c-b386-b76e88bf4ac4 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 514a7771-fbf2-46db-9e3d-905a6a3e703d] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:06:58.883531 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-4b301b7b-a6d5-4d0c-b386-b76e88bf4ac4 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:58.883985 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-4b301b7b-a6d5-4d0c-b386-b76e88bf4ac4 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:58.884757 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-4b301b7b-a6d5-4d0c-b386-b76e88bf4ac4 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:06:58.885194 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-4b301b7b-a6d5-4d0c-b386-b76e88bf4ac4 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:06:59.074428 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-4b301b7b-a6d5-4d0c-b386-b76e88bf4ac4 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:06:59.082489 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-4b301b7b-a6d5-4d0c-b386-b76e88bf4ac4 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d" status: 200 len: 1521 microversion: 2.1 time: 0.210120 Jul 21 20:06:59.083067 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 162/345] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:06:58 2022] GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d => generated 1521 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:07:00.101260 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-4a7cb286-0a9c-427a-90d0-d6e91d6a4214 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:07:00.101995 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-4a7cb286-0a9c-427a-90d0-d6e91d6a4214 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 514a7771-fbf2-46db-9e3d-905a6a3e703d] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:07:00.104457 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_api:SELECT=42 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:07:00.111371 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4a7cb286-0a9c-427a-90d0-d6e91d6a4214 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:07:00.112288 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4a7cb286-0a9c-427a-90d0-d6e91d6a4214 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:07:00.113258 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4a7cb286-0a9c-427a-90d0-d6e91d6a4214 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:07:00.113699 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4a7cb286-0a9c-427a-90d0-d6e91d6a4214 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:07:00.257819 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-4a7cb286-0a9c-427a-90d0-d6e91d6a4214 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:07:00.265280 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-4a7cb286-0a9c-427a-90d0-d6e91d6a4214 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d" status: 200 len: 1521 microversion: 2.1 time: 0.169498 Jul 21 20:07:00.265835 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 184/346] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:07:00 2022] GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:07:01.283889 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-dbe18674-67c0-4369-80f2-44a06e4abf56 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:07:01.285020 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-dbe18674-67c0-4369-80f2-44a06e4abf56 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 514a7771-fbf2-46db-9e3d-905a6a3e703d] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:07:01.292035 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-dbe18674-67c0-4369-80f2-44a06e4abf56 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:07:01.292620 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-dbe18674-67c0-4369-80f2-44a06e4abf56 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:07:01.293486 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-dbe18674-67c0-4369-80f2-44a06e4abf56 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:07:01.294430 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-dbe18674-67c0-4369-80f2-44a06e4abf56 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:07:01.432787 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-dbe18674-67c0-4369-80f2-44a06e4abf56 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:07:01.442238 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-dbe18674-67c0-4369-80f2-44a06e4abf56 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d" status: 200 len: 1501 microversion: 2.1 time: 0.163536 Jul 21 20:07:01.442836 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 163/347] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:07:01 2022] GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d => generated 1501 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:07:01.458461 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-e31acf29-b8fe-4255-bfdf-014d69cf5ba1 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:07:01.459005 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-e31acf29-b8fe-4255-bfdf-014d69cf5ba1 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 3a615f10-936f-48d1-aad9-e414dc31d016] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:07:01.465519 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e31acf29-b8fe-4255-bfdf-014d69cf5ba1 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:07:01.466002 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e31acf29-b8fe-4255-bfdf-014d69cf5ba1 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:07:01.466760 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e31acf29-b8fe-4255-bfdf-014d69cf5ba1 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:07:01.467234 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e31acf29-b8fe-4255-bfdf-014d69cf5ba1 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:07:01.597173 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-e31acf29-b8fe-4255-bfdf-014d69cf5ba1 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:07:01.604636 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-e31acf29-b8fe-4255-bfdf-014d69cf5ba1 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/3a615f10-936f-48d1-aad9-e414dc31d016" status: 200 len: 1515 microversion: 2.1 time: 0.150138 Jul 21 20:07:01.615161 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 185/348] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:07:01 2022] GET /compute/v2.1/servers/3a615f10-936f-48d1-aad9-e414dc31d016 => generated 1515 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:07:05.698302 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-5d45ab4b-0d15-4abd-b8b1-7112b62b7fb0 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:07:05.699526 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-5d45ab4b-0d15-4abd-b8b1-7112b62b7fb0 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 3a615f10-936f-48d1-aad9-e414dc31d016] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:07:05.708668 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-5d45ab4b-0d15-4abd-b8b1-7112b62b7fb0 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:07:05.709128 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-5d45ab4b-0d15-4abd-b8b1-7112b62b7fb0 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:07:05.709904 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-5d45ab4b-0d15-4abd-b8b1-7112b62b7fb0 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:07:05.710339 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-5d45ab4b-0d15-4abd-b8b1-7112b62b7fb0 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:07:05.712793 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG dbcounter [-] [118344] Writing DB stats nova_cell1:SELECT=73 {{(pid=118344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:07:05.738206 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.objects.instance [None req-5d45ab4b-0d15-4abd-b8b1-7112b62b7fb0 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lazy-loading 'flavor' on Instance uuid 3a615f10-936f-48d1-aad9-e414dc31d016 {{(pid=118344) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 20:07:06.017448 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-5d45ab4b-0d15-4abd-b8b1-7112b62b7fb0 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "POST /compute/v2.1/servers/3a615f10-936f-48d1-aad9-e414dc31d016/action" status: 200 len: 32 microversion: 2.1 time: 0.325764 Jul 21 20:07:06.018034 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 164/349] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Jul 21 20:07:05 2022] POST /compute/v2.1/servers/3a615f10-936f-48d1-aad9-e414dc31d016/action => generated 32 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 21 20:07:06.027803 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-3122f34d-48ef-483c-b3d3-d09908eea551 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:07:06.028526 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-3122f34d-48ef-483c-b3d3-d09908eea551 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 3a615f10-936f-48d1-aad9-e414dc31d016] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:07:06.035337 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3122f34d-48ef-483c-b3d3-d09908eea551 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:07:06.035875 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3122f34d-48ef-483c-b3d3-d09908eea551 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:07:06.036656 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3122f34d-48ef-483c-b3d3-d09908eea551 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:07:06.037092 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3122f34d-48ef-483c-b3d3-d09908eea551 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:07:06.191691 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-3122f34d-48ef-483c-b3d3-d09908eea551 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:07:06.199059 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-3122f34d-48ef-483c-b3d3-d09908eea551 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/3a615f10-936f-48d1-aad9-e414dc31d016" status: 200 len: 1521 microversion: 2.1 time: 0.175144 Jul 21 20:07:06.199695 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 186/350] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:07:06 2022] GET /compute/v2.1/servers/3a615f10-936f-48d1-aad9-e414dc31d016 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:07:07.216741 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-f42b23e8-6f32-4fae-b058-b8c3a37bc6c3 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:07:07.217428 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-f42b23e8-6f32-4fae-b058-b8c3a37bc6c3 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 3a615f10-936f-48d1-aad9-e414dc31d016] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:07:07.224667 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f42b23e8-6f32-4fae-b058-b8c3a37bc6c3 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:07:07.225108 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f42b23e8-6f32-4fae-b058-b8c3a37bc6c3 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:07:07.225859 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f42b23e8-6f32-4fae-b058-b8c3a37bc6c3 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:07:07.226286 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f42b23e8-6f32-4fae-b058-b8c3a37bc6c3 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:07:07.357673 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-f42b23e8-6f32-4fae-b058-b8c3a37bc6c3 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:07:07.365023 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-f42b23e8-6f32-4fae-b058-b8c3a37bc6c3 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/3a615f10-936f-48d1-aad9-e414dc31d016" status: 200 len: 1521 microversion: 2.1 time: 0.152511 Jul 21 20:07:07.365599 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 165/351] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:07:07 2022] GET /compute/v2.1/servers/3a615f10-936f-48d1-aad9-e414dc31d016 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:07:08.382064 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-bd82ac5c-767f-45f2-b19e-2a856ea93116 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:07:08.382670 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-bd82ac5c-767f-45f2-b19e-2a856ea93116 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 3a615f10-936f-48d1-aad9-e414dc31d016] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:07:08.388791 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-bd82ac5c-767f-45f2-b19e-2a856ea93116 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:07:08.389230 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-bd82ac5c-767f-45f2-b19e-2a856ea93116 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:07:08.389993 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-bd82ac5c-767f-45f2-b19e-2a856ea93116 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:07:08.390426 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-bd82ac5c-767f-45f2-b19e-2a856ea93116 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:07:08.517998 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-bd82ac5c-767f-45f2-b19e-2a856ea93116 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:07:08.526017 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-bd82ac5c-767f-45f2-b19e-2a856ea93116 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/3a615f10-936f-48d1-aad9-e414dc31d016" status: 200 len: 1521 microversion: 2.1 time: 0.148323 Jul 21 20:07:08.526584 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 187/352] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:07:08 2022] GET /compute/v2.1/servers/3a615f10-936f-48d1-aad9-e414dc31d016 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:07:09.543173 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-45e6815d-b216-47ec-b46b-0980722fc5d4 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:07:09.543676 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-45e6815d-b216-47ec-b46b-0980722fc5d4 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 3a615f10-936f-48d1-aad9-e414dc31d016] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:07:09.550108 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-45e6815d-b216-47ec-b46b-0980722fc5d4 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:07:09.551103 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-45e6815d-b216-47ec-b46b-0980722fc5d4 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:07:09.551862 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-45e6815d-b216-47ec-b46b-0980722fc5d4 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:07:09.552285 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-45e6815d-b216-47ec-b46b-0980722fc5d4 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:07:09.699228 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-45e6815d-b216-47ec-b46b-0980722fc5d4 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:07:09.706976 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-45e6815d-b216-47ec-b46b-0980722fc5d4 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/3a615f10-936f-48d1-aad9-e414dc31d016" status: 200 len: 1521 microversion: 2.1 time: 0.167914 Jul 21 20:07:09.716665 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 166/353] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:07:09 2022] GET /compute/v2.1/servers/3a615f10-936f-48d1-aad9-e414dc31d016 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:07:10.724819 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-7978edfa-6d2a-4cc2-8f8f-6e975c4cc843 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:07:10.725429 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-7978edfa-6d2a-4cc2-8f8f-6e975c4cc843 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 3a615f10-936f-48d1-aad9-e414dc31d016] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:07:10.731657 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-7978edfa-6d2a-4cc2-8f8f-6e975c4cc843 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:07:10.732101 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-7978edfa-6d2a-4cc2-8f8f-6e975c4cc843 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:07:10.732866 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-7978edfa-6d2a-4cc2-8f8f-6e975c4cc843 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:07:10.733300 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-7978edfa-6d2a-4cc2-8f8f-6e975c4cc843 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:07:10.860216 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-7978edfa-6d2a-4cc2-8f8f-6e975c4cc843 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:07:10.867641 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-7978edfa-6d2a-4cc2-8f8f-6e975c4cc843 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/3a615f10-936f-48d1-aad9-e414dc31d016" status: 200 len: 1521 microversion: 2.1 time: 0.147228 Jul 21 20:07:10.868208 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 188/354] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:07:10 2022] GET /compute/v2.1/servers/3a615f10-936f-48d1-aad9-e414dc31d016 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:07:11.885663 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-92227679-bd8e-46ab-9a19-13ae51553198 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:07:11.886272 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-92227679-bd8e-46ab-9a19-13ae51553198 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 3a615f10-936f-48d1-aad9-e414dc31d016] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:07:11.892726 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-92227679-bd8e-46ab-9a19-13ae51553198 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:07:11.893172 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-92227679-bd8e-46ab-9a19-13ae51553198 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:07:11.894079 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-92227679-bd8e-46ab-9a19-13ae51553198 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:07:11.894512 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-92227679-bd8e-46ab-9a19-13ae51553198 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:07:12.023152 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-92227679-bd8e-46ab-9a19-13ae51553198 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:07:12.030614 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-92227679-bd8e-46ab-9a19-13ae51553198 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/3a615f10-936f-48d1-aad9-e414dc31d016" status: 200 len: 1521 microversion: 2.1 time: 0.149030 Jul 21 20:07:12.031195 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 167/355] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:07:11 2022] GET /compute/v2.1/servers/3a615f10-936f-48d1-aad9-e414dc31d016 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:07:13.048171 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-2c4c2d41-b845-4510-a9b8-9be6c57e1e04 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:07:13.048715 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-2c4c2d41-b845-4510-a9b8-9be6c57e1e04 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 3a615f10-936f-48d1-aad9-e414dc31d016] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:07:13.055493 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2c4c2d41-b845-4510-a9b8-9be6c57e1e04 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:07:13.056007 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2c4c2d41-b845-4510-a9b8-9be6c57e1e04 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:07:13.056776 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2c4c2d41-b845-4510-a9b8-9be6c57e1e04 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:07:13.057250 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2c4c2d41-b845-4510-a9b8-9be6c57e1e04 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:07:13.190523 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-2c4c2d41-b845-4510-a9b8-9be6c57e1e04 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:07:13.198195 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-2c4c2d41-b845-4510-a9b8-9be6c57e1e04 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/3a615f10-936f-48d1-aad9-e414dc31d016" status: 200 len: 1521 microversion: 2.1 time: 0.154032 Jul 21 20:07:13.198853 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 189/356] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:07:13 2022] GET /compute/v2.1/servers/3a615f10-936f-48d1-aad9-e414dc31d016 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:07:14.215811 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-4f83a690-cdd5-42c3-910c-472b7586b8e5 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:07:14.216419 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-4f83a690-cdd5-42c3-910c-472b7586b8e5 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 3a615f10-936f-48d1-aad9-e414dc31d016] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:07:14.223185 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-4f83a690-cdd5-42c3-910c-472b7586b8e5 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:07:14.223636 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-4f83a690-cdd5-42c3-910c-472b7586b8e5 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:07:14.224399 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-4f83a690-cdd5-42c3-910c-472b7586b8e5 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:07:14.224842 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-4f83a690-cdd5-42c3-910c-472b7586b8e5 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:07:14.353456 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-4f83a690-cdd5-42c3-910c-472b7586b8e5 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:07:14.360895 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-4f83a690-cdd5-42c3-910c-472b7586b8e5 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/3a615f10-936f-48d1-aad9-e414dc31d016" status: 200 len: 1521 microversion: 2.1 time: 0.148921 Jul 21 20:07:14.361408 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 168/357] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:07:14 2022] GET /compute/v2.1/servers/3a615f10-936f-48d1-aad9-e414dc31d016 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:07:15.377611 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-903aa4d2-c3e5-48a0-ab38-497ded451655 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:07:15.378223 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-903aa4d2-c3e5-48a0-ab38-497ded451655 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 3a615f10-936f-48d1-aad9-e414dc31d016] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:07:15.384754 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-903aa4d2-c3e5-48a0-ab38-497ded451655 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:07:15.385201 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-903aa4d2-c3e5-48a0-ab38-497ded451655 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:07:15.385958 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-903aa4d2-c3e5-48a0-ab38-497ded451655 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:07:15.386391 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-903aa4d2-c3e5-48a0-ab38-497ded451655 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:07:15.514202 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-903aa4d2-c3e5-48a0-ab38-497ded451655 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:07:15.521670 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-903aa4d2-c3e5-48a0-ab38-497ded451655 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/3a615f10-936f-48d1-aad9-e414dc31d016" status: 200 len: 1521 microversion: 2.1 time: 0.147945 Jul 21 20:07:15.522227 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 190/358] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:07:15 2022] GET /compute/v2.1/servers/3a615f10-936f-48d1-aad9-e414dc31d016 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:07:16.539746 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-dd7f273f-9269-450c-bb99-0236d317bf8d tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:07:16.540381 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-dd7f273f-9269-450c-bb99-0236d317bf8d tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 3a615f10-936f-48d1-aad9-e414dc31d016] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:07:16.547570 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-dd7f273f-9269-450c-bb99-0236d317bf8d tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:07:16.548011 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-dd7f273f-9269-450c-bb99-0236d317bf8d tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:07:16.548837 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-dd7f273f-9269-450c-bb99-0236d317bf8d tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:07:16.549300 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-dd7f273f-9269-450c-bb99-0236d317bf8d tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:07:16.680699 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-dd7f273f-9269-450c-bb99-0236d317bf8d tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:07:16.688494 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-dd7f273f-9269-450c-bb99-0236d317bf8d tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/3a615f10-936f-48d1-aad9-e414dc31d016" status: 200 len: 1521 microversion: 2.1 time: 0.153254 Jul 21 20:07:16.689049 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 169/359] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:07:16 2022] GET /compute/v2.1/servers/3a615f10-936f-48d1-aad9-e414dc31d016 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:07:17.705151 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-e3b9fa5f-05f6-4467-a6a5-f376c055c4eb tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:07:17.705759 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-e3b9fa5f-05f6-4467-a6a5-f376c055c4eb tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 3a615f10-936f-48d1-aad9-e414dc31d016] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:07:17.712352 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e3b9fa5f-05f6-4467-a6a5-f376c055c4eb tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:07:17.717254 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e3b9fa5f-05f6-4467-a6a5-f376c055c4eb tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:07:17.717254 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e3b9fa5f-05f6-4467-a6a5-f376c055c4eb tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:07:17.717254 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e3b9fa5f-05f6-4467-a6a5-f376c055c4eb tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:07:17.859413 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-e3b9fa5f-05f6-4467-a6a5-f376c055c4eb tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:07:17.867194 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-e3b9fa5f-05f6-4467-a6a5-f376c055c4eb tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/3a615f10-936f-48d1-aad9-e414dc31d016" status: 200 len: 1521 microversion: 2.1 time: 0.165804 Jul 21 20:07:17.867832 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 191/360] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:07:17 2022] GET /compute/v2.1/servers/3a615f10-936f-48d1-aad9-e414dc31d016 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:07:18.885086 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-8989591a-8237-46f5-aa14-cd624bba311c tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:07:18.885813 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-8989591a-8237-46f5-aa14-cd624bba311c tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 3a615f10-936f-48d1-aad9-e414dc31d016] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:07:18.892482 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-8989591a-8237-46f5-aa14-cd624bba311c tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:07:18.892932 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-8989591a-8237-46f5-aa14-cd624bba311c tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:07:18.893730 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-8989591a-8237-46f5-aa14-cd624bba311c tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:07:18.894169 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-8989591a-8237-46f5-aa14-cd624bba311c tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:07:19.020728 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-8989591a-8237-46f5-aa14-cd624bba311c tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:07:19.028293 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-8989591a-8237-46f5-aa14-cd624bba311c tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/3a615f10-936f-48d1-aad9-e414dc31d016" status: 200 len: 1521 microversion: 2.1 time: 0.147509 Jul 21 20:07:19.028858 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 170/361] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:07:18 2022] GET /compute/v2.1/servers/3a615f10-936f-48d1-aad9-e414dc31d016 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:07:20.044925 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-bda101f4-ec17-461a-affc-f751c37250ff tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:07:20.045626 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-bda101f4-ec17-461a-affc-f751c37250ff tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 3a615f10-936f-48d1-aad9-e414dc31d016] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:07:20.052762 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-bda101f4-ec17-461a-affc-f751c37250ff tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:07:20.053230 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-bda101f4-ec17-461a-affc-f751c37250ff tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:07:20.053983 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-bda101f4-ec17-461a-affc-f751c37250ff tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:07:20.054410 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-bda101f4-ec17-461a-affc-f751c37250ff tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:07:20.187988 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-bda101f4-ec17-461a-affc-f751c37250ff tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:07:20.195415 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-bda101f4-ec17-461a-affc-f751c37250ff tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/3a615f10-936f-48d1-aad9-e414dc31d016" status: 200 len: 1521 microversion: 2.1 time: 0.154672 Jul 21 20:07:20.195978 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 192/362] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:07:20 2022] GET /compute/v2.1/servers/3a615f10-936f-48d1-aad9-e414dc31d016 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:07:21.213028 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-e5b220d6-9ee7-459c-b9e2-aad91d535141 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:07:21.213695 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-e5b220d6-9ee7-459c-b9e2-aad91d535141 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 3a615f10-936f-48d1-aad9-e414dc31d016] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:07:21.216339 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG dbcounter [-] [118344] Writing DB stats nova_api:SELECT=26 {{(pid=118344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:07:21.221433 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-e5b220d6-9ee7-459c-b9e2-aad91d535141 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:07:21.221879 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-e5b220d6-9ee7-459c-b9e2-aad91d535141 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:07:21.222643 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-e5b220d6-9ee7-459c-b9e2-aad91d535141 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:07:21.223113 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-e5b220d6-9ee7-459c-b9e2-aad91d535141 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:07:21.355282 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-e5b220d6-9ee7-459c-b9e2-aad91d535141 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:07:21.362747 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-e5b220d6-9ee7-459c-b9e2-aad91d535141 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/3a615f10-936f-48d1-aad9-e414dc31d016" status: 200 len: 1521 microversion: 2.1 time: 0.154204 Jul 21 20:07:21.363343 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 171/363] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:07:21 2022] GET /compute/v2.1/servers/3a615f10-936f-48d1-aad9-e414dc31d016 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:07:22.379723 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-915ab833-a80d-4bb5-b391-6bd28908c307 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:07:22.380862 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-915ab833-a80d-4bb5-b391-6bd28908c307 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 3a615f10-936f-48d1-aad9-e414dc31d016] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:07:22.387113 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-915ab833-a80d-4bb5-b391-6bd28908c307 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:07:22.387567 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-915ab833-a80d-4bb5-b391-6bd28908c307 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:07:22.388326 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-915ab833-a80d-4bb5-b391-6bd28908c307 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:07:22.388801 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-915ab833-a80d-4bb5-b391-6bd28908c307 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:07:22.524550 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-915ab833-a80d-4bb5-b391-6bd28908c307 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:07:22.531872 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-915ab833-a80d-4bb5-b391-6bd28908c307 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/3a615f10-936f-48d1-aad9-e414dc31d016" status: 200 len: 1521 microversion: 2.1 time: 0.156139 Jul 21 20:07:22.532428 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 193/364] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:07:22 2022] GET /compute/v2.1/servers/3a615f10-936f-48d1-aad9-e414dc31d016 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:07:23.548892 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-3e8a0210-7e4c-44b8-bb77-5ef88125042c tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:07:23.549497 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-3e8a0210-7e4c-44b8-bb77-5ef88125042c tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 3a615f10-936f-48d1-aad9-e414dc31d016] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:07:23.556211 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-3e8a0210-7e4c-44b8-bb77-5ef88125042c tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:07:23.556678 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-3e8a0210-7e4c-44b8-bb77-5ef88125042c tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:07:23.557464 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-3e8a0210-7e4c-44b8-bb77-5ef88125042c tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:07:23.557937 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-3e8a0210-7e4c-44b8-bb77-5ef88125042c tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:07:23.689245 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-3e8a0210-7e4c-44b8-bb77-5ef88125042c tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:07:23.696733 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-3e8a0210-7e4c-44b8-bb77-5ef88125042c tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/3a615f10-936f-48d1-aad9-e414dc31d016" status: 200 len: 1521 microversion: 2.1 time: 0.151855 Jul 21 20:07:23.697288 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 172/365] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:07:23 2022] GET /compute/v2.1/servers/3a615f10-936f-48d1-aad9-e414dc31d016 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:07:24.714224 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-c3086471-2375-4404-a5b5-ccc8e0cd0cb3 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:07:24.714837 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-c3086471-2375-4404-a5b5-ccc8e0cd0cb3 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 3a615f10-936f-48d1-aad9-e414dc31d016] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:07:24.721249 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c3086471-2375-4404-a5b5-ccc8e0cd0cb3 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:07:24.721742 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c3086471-2375-4404-a5b5-ccc8e0cd0cb3 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:07:24.722501 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c3086471-2375-4404-a5b5-ccc8e0cd0cb3 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:07:24.722966 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c3086471-2375-4404-a5b5-ccc8e0cd0cb3 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:07:24.853565 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-c3086471-2375-4404-a5b5-ccc8e0cd0cb3 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:07:24.861043 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-c3086471-2375-4404-a5b5-ccc8e0cd0cb3 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/3a615f10-936f-48d1-aad9-e414dc31d016" status: 200 len: 1521 microversion: 2.1 time: 0.150707 Jul 21 20:07:24.861604 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 194/366] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:07:24 2022] GET /compute/v2.1/servers/3a615f10-936f-48d1-aad9-e414dc31d016 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:07:25.877703 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-ff9249ba-d8d6-4a64-ac15-7845b14a0106 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:07:25.878398 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-ff9249ba-d8d6-4a64-ac15-7845b14a0106 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 3a615f10-936f-48d1-aad9-e414dc31d016] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:07:25.885453 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-ff9249ba-d8d6-4a64-ac15-7845b14a0106 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:07:25.885899 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-ff9249ba-d8d6-4a64-ac15-7845b14a0106 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:07:25.886664 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-ff9249ba-d8d6-4a64-ac15-7845b14a0106 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:07:25.887167 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-ff9249ba-d8d6-4a64-ac15-7845b14a0106 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:07:26.032191 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-ff9249ba-d8d6-4a64-ac15-7845b14a0106 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:07:26.040357 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-ff9249ba-d8d6-4a64-ac15-7845b14a0106 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/3a615f10-936f-48d1-aad9-e414dc31d016" status: 200 len: 1521 microversion: 2.1 time: 0.166573 Jul 21 20:07:26.040921 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 173/367] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:07:25 2022] GET /compute/v2.1/servers/3a615f10-936f-48d1-aad9-e414dc31d016 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:07:27.058910 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-f9e49aff-07a1-4ca7-9eb0-0bbf09baf920 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:07:27.059785 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-f9e49aff-07a1-4ca7-9eb0-0bbf09baf920 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 3a615f10-936f-48d1-aad9-e414dc31d016] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:07:27.066164 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f9e49aff-07a1-4ca7-9eb0-0bbf09baf920 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:07:27.066891 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f9e49aff-07a1-4ca7-9eb0-0bbf09baf920 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:07:27.067740 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f9e49aff-07a1-4ca7-9eb0-0bbf09baf920 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:07:27.068211 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f9e49aff-07a1-4ca7-9eb0-0bbf09baf920 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:07:27.210497 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-f9e49aff-07a1-4ca7-9eb0-0bbf09baf920 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:07:27.219010 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-f9e49aff-07a1-4ca7-9eb0-0bbf09baf920 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/3a615f10-936f-48d1-aad9-e414dc31d016" status: 200 len: 1521 microversion: 2.1 time: 0.164923 Jul 21 20:07:27.219600 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 195/368] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:07:27 2022] GET /compute/v2.1/servers/3a615f10-936f-48d1-aad9-e414dc31d016 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:07:28.237053 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-0432d7de-9c41-45b1-affd-1938949d1c5f tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:07:28.237648 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-0432d7de-9c41-45b1-affd-1938949d1c5f tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 3a615f10-936f-48d1-aad9-e414dc31d016] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:07:28.244364 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-0432d7de-9c41-45b1-affd-1938949d1c5f tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:07:28.244813 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-0432d7de-9c41-45b1-affd-1938949d1c5f tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:07:28.245581 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-0432d7de-9c41-45b1-affd-1938949d1c5f tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:07:28.246024 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-0432d7de-9c41-45b1-affd-1938949d1c5f tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:07:28.387670 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-0432d7de-9c41-45b1-affd-1938949d1c5f tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:07:28.395419 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-0432d7de-9c41-45b1-affd-1938949d1c5f tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/3a615f10-936f-48d1-aad9-e414dc31d016" status: 200 len: 1521 microversion: 2.1 time: 0.162210 Jul 21 20:07:28.396073 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 174/369] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:07:28 2022] GET /compute/v2.1/servers/3a615f10-936f-48d1-aad9-e414dc31d016 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:07:29.413954 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-e1171b4f-a926-4e9b-a155-95970e856a4b tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:07:29.414548 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-e1171b4f-a926-4e9b-a155-95970e856a4b tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 3a615f10-936f-48d1-aad9-e414dc31d016] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:07:29.420543 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e1171b4f-a926-4e9b-a155-95970e856a4b tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:07:29.420985 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e1171b4f-a926-4e9b-a155-95970e856a4b tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:07:29.421765 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e1171b4f-a926-4e9b-a155-95970e856a4b tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:07:29.422214 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e1171b4f-a926-4e9b-a155-95970e856a4b tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:07:29.563425 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-e1171b4f-a926-4e9b-a155-95970e856a4b tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:07:29.570856 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-e1171b4f-a926-4e9b-a155-95970e856a4b tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/3a615f10-936f-48d1-aad9-e414dc31d016" status: 200 len: 1521 microversion: 2.1 time: 0.161227 Jul 21 20:07:29.571451 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 196/370] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:07:29 2022] GET /compute/v2.1/servers/3a615f10-936f-48d1-aad9-e414dc31d016 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:07:30.587658 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-a64ce80a-0f34-4809-b9d8-bbf89b10c60f tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:07:30.588271 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-a64ce80a-0f34-4809-b9d8-bbf89b10c60f tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 3a615f10-936f-48d1-aad9-e414dc31d016] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:07:30.595159 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-a64ce80a-0f34-4809-b9d8-bbf89b10c60f tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:07:30.599248 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-a64ce80a-0f34-4809-b9d8-bbf89b10c60f tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:07:30.599248 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-a64ce80a-0f34-4809-b9d8-bbf89b10c60f tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:07:30.599248 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-a64ce80a-0f34-4809-b9d8-bbf89b10c60f tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:07:30.731901 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-a64ce80a-0f34-4809-b9d8-bbf89b10c60f tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:07:30.739366 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-a64ce80a-0f34-4809-b9d8-bbf89b10c60f tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/3a615f10-936f-48d1-aad9-e414dc31d016" status: 200 len: 1521 microversion: 2.1 time: 0.155616 Jul 21 20:07:30.740604 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 175/371] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:07:30 2022] GET /compute/v2.1/servers/3a615f10-936f-48d1-aad9-e414dc31d016 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:07:31.756948 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-807112e2-6013-4021-a682-3baa18053a08 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:07:31.757584 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-807112e2-6013-4021-a682-3baa18053a08 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 3a615f10-936f-48d1-aad9-e414dc31d016] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:07:31.759553 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_api:SELECT=26 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:07:31.764255 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-807112e2-6013-4021-a682-3baa18053a08 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:07:31.764703 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-807112e2-6013-4021-a682-3baa18053a08 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:07:31.765474 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-807112e2-6013-4021-a682-3baa18053a08 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:07:31.765929 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-807112e2-6013-4021-a682-3baa18053a08 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:07:31.768483 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell1:SELECT=83 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:07:31.896852 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-807112e2-6013-4021-a682-3baa18053a08 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:07:31.904165 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-807112e2-6013-4021-a682-3baa18053a08 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/3a615f10-936f-48d1-aad9-e414dc31d016" status: 200 len: 1521 microversion: 2.1 time: 0.151274 Jul 21 20:07:31.904733 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 197/372] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:07:31 2022] GET /compute/v2.1/servers/3a615f10-936f-48d1-aad9-e414dc31d016 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:07:32.921986 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-48c4d684-b6e3-4526-baf4-1fc5b35068e0 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:07:32.922545 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-48c4d684-b6e3-4526-baf4-1fc5b35068e0 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 3a615f10-936f-48d1-aad9-e414dc31d016] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:07:32.929512 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-48c4d684-b6e3-4526-baf4-1fc5b35068e0 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:07:32.929963 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-48c4d684-b6e3-4526-baf4-1fc5b35068e0 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:07:32.930793 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-48c4d684-b6e3-4526-baf4-1fc5b35068e0 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:07:32.931259 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-48c4d684-b6e3-4526-baf4-1fc5b35068e0 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:07:33.064636 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-48c4d684-b6e3-4526-baf4-1fc5b35068e0 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:07:33.072552 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-48c4d684-b6e3-4526-baf4-1fc5b35068e0 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/3a615f10-936f-48d1-aad9-e414dc31d016" status: 200 len: 1521 microversion: 2.1 time: 0.154803 Jul 21 20:07:33.073113 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 176/373] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:07:32 2022] GET /compute/v2.1/servers/3a615f10-936f-48d1-aad9-e414dc31d016 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:07:34.089362 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-ad71fe4c-7bf5-41f5-a4e0-2eecd75bc307 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:07:34.090003 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-ad71fe4c-7bf5-41f5-a4e0-2eecd75bc307 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 3a615f10-936f-48d1-aad9-e414dc31d016] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:07:34.096557 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ad71fe4c-7bf5-41f5-a4e0-2eecd75bc307 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:07:34.097039 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ad71fe4c-7bf5-41f5-a4e0-2eecd75bc307 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:07:34.111582 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ad71fe4c-7bf5-41f5-a4e0-2eecd75bc307 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:07:34.111582 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ad71fe4c-7bf5-41f5-a4e0-2eecd75bc307 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:07:34.226002 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-ad71fe4c-7bf5-41f5-a4e0-2eecd75bc307 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:07:34.233786 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-ad71fe4c-7bf5-41f5-a4e0-2eecd75bc307 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/3a615f10-936f-48d1-aad9-e414dc31d016" status: 200 len: 1521 microversion: 2.1 time: 0.148479 Jul 21 20:07:34.234353 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 198/374] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:07:34 2022] GET /compute/v2.1/servers/3a615f10-936f-48d1-aad9-e414dc31d016 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:07:35.251316 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-ab702042-6f21-4eae-9619-0308c81b9835 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:07:35.251974 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-ab702042-6f21-4eae-9619-0308c81b9835 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 3a615f10-936f-48d1-aad9-e414dc31d016] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:07:35.258945 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-ab702042-6f21-4eae-9619-0308c81b9835 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:07:35.259429 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-ab702042-6f21-4eae-9619-0308c81b9835 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:07:35.260162 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-ab702042-6f21-4eae-9619-0308c81b9835 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:07:35.260585 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-ab702042-6f21-4eae-9619-0308c81b9835 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:07:35.390278 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-ab702042-6f21-4eae-9619-0308c81b9835 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:07:35.397692 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-ab702042-6f21-4eae-9619-0308c81b9835 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/3a615f10-936f-48d1-aad9-e414dc31d016" status: 200 len: 1521 microversion: 2.1 time: 0.150372 Jul 21 20:07:35.398258 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 177/375] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:07:35 2022] GET /compute/v2.1/servers/3a615f10-936f-48d1-aad9-e414dc31d016 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:07:36.416097 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-f8978719-c18a-4dca-8be6-665aec31a312 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:07:36.416760 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-f8978719-c18a-4dca-8be6-665aec31a312 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 3a615f10-936f-48d1-aad9-e414dc31d016] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:07:36.422946 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f8978719-c18a-4dca-8be6-665aec31a312 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:07:36.423428 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f8978719-c18a-4dca-8be6-665aec31a312 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:07:36.424231 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f8978719-c18a-4dca-8be6-665aec31a312 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:07:36.424666 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f8978719-c18a-4dca-8be6-665aec31a312 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:07:36.565627 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-f8978719-c18a-4dca-8be6-665aec31a312 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:07:36.573977 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-f8978719-c18a-4dca-8be6-665aec31a312 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/3a615f10-936f-48d1-aad9-e414dc31d016" status: 200 len: 1501 microversion: 2.1 time: 0.161918 Jul 21 20:07:36.574546 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 199/376] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:07:36 2022] GET /compute/v2.1/servers/3a615f10-936f-48d1-aad9-e414dc31d016 => generated 1501 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:07:36.590203 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-f0c99cbb-7f43-4828-b6c3-da5142dd390b tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1855bbc0-5afc-4752-9efc-12a30f2148dc"}} {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:07:36.591359 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-f0c99cbb-7f43-4828-b6c3-da5142dd390b tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 3a615f10-936f-48d1-aad9-e414dc31d016] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:07:36.598129 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f0c99cbb-7f43-4828-b6c3-da5142dd390b tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:07:36.598577 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f0c99cbb-7f43-4828-b6c3-da5142dd390b tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:07:36.599404 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f0c99cbb-7f43-4828-b6c3-da5142dd390b tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:07:36.599845 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f0c99cbb-7f43-4828-b6c3-da5142dd390b tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:07:36.602282 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG dbcounter [-] [118344] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:07:36.624147 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.wsgi [None req-f0c99cbb-7f43-4828-b6c3-da5142dd390b tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] HTTP exception thrown: Cannot 'attach_volume' instance 3a615f10-936f-48d1-aad9-e414dc31d016 while it is in vm_state rescued Jul 21 20:07:36.625841 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-f0c99cbb-7f43-4828-b6c3-da5142dd390b tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Request method failure captured: Jul 21 20:07:36.625841 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: request: POST /compute/v2.1/servers/3a615f10-936f-48d1-aad9-e414dc31d016/os-volume_attachments HTTP/1.1 Jul 21 20:07:36.625841 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Accept: application/json Jul 21 20:07:36.625841 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Accept-Encoding: identity Jul 21 20:07:36.625841 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Connection: close Jul 21 20:07:36.625841 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Content-Length: 74 Jul 21 20:07:36.625841 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Content-Type: application/json Jul 21 20:07:36.625841 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Host: 10.222.0.58 Jul 21 20:07:36.625841 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Openstack-System-Scope: None Jul 21 20:07:36.625841 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: User-Agent: python-urllib3/1.26.9 Jul 21 20:07:36.625841 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Auth-Token: gAAAAABi2bFozFOmeFjCWltvy8VhOWCofqDkL3eFiDeXHKMTK5OfgvASsxAtL3iRYEdZZ7pOuKVQA34GMN_bqQ_UDkdmJ9edR5NJ1MVnnwiRBdlInNadgfKnNIDs7Z86jLqiTMWRcpjxhBqQIcTH49W1JEnUteXxWbRKxG7NWslugE8wtbbj48I Jul 21 20:07:36.625841 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Domain-Id: None Jul 21 20:07:36.625841 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Domain-Name: None Jul 21 20:07:36.625841 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Identity-Status: Confirmed Jul 21 20:07:36.625841 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Is-Admin-Project: True Jul 21 20:07:36.625841 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Domain-Id: default Jul 21 20:07:36.625841 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Domain-Name: Default Jul 21 20:07:36.625841 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Id: 6d4acf1287ad4dac9bbf6dc27f427a7c Jul 21 20:07:36.625841 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1971750390 Jul 21 20:07:36.625841 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Role: reader,member Jul 21 20:07:36.625841 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Roles: reader,member Jul 21 20:07:36.627241 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/6d4acf1287ad4dac9bbf6dc27f427a7c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6d4acf1287ad4dac9bbf6dc27f427a7c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_6d4acf1287ad4dac9bbf6dc27f427a7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6d4acf1287ad4dac9bbf6dc27f427a7c"}]}] Jul 21 20:07:36.627241 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1971750390 Jul 21 20:07:36.627241 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Tenant-Id: 6d4acf1287ad4dac9bbf6dc27f427a7c Jul 21 20:07:36.627241 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1971750390 Jul 21 20:07:36.627241 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User: tempest-ServerRescueNegativeTestJSON-1971750390-project Jul 21 20:07:36.627241 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Domain-Id: default Jul 21 20:07:36.627241 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Domain-Name: Default Jul 21 20:07:36.627241 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Id: df9139f72d004b2fac1cba17647c129d Jul 21 20:07:36.627241 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1971750390-project Jul 21 20:07:36.627241 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Jul 21 20:07:36.627241 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: {"volumeAttachment": {"volumeId": "1855bbc0-5afc-4752-9efc-12a30f2148dc"}} Jul 21 20:07:36.627241 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: method: > Jul 21 20:07:36.628011 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: exception: Cannot 'attach_volume' instance 3a615f10-936f-48d1-aad9-e414dc31d016 while it is in vm_state rescued Jul 21 20:07:36.628011 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: action_args: {'server_id': '3a615f10-936f-48d1-aad9-e414dc31d016', 'body': {'volumeAttachment': {'volumeId': '1855bbc0-5afc-4752-9efc-12a30f2148dc'}}} Jul 21 20:07:36.628011 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 20:07:36.628011 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:07:36.628011 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 21 20:07:36.628011 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 21 20:07:36.628011 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 21 20:07:36.628011 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 21 20:07:36.628011 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 21 20:07:36.628011 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 21 20:07:36.628011 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3a615f10-936f-48d1-aad9-e414dc31d016 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 21 20:07:36.628011 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:07:36.628011 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:07:36.628011 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:07:36.628011 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:07:36.628011 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:07:36.628011 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:07:36.628011 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 20:07:36.628011 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 20:07:36.629406 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 20:07:36.629406 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 20:07:36.629406 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 21 20:07:36.629406 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 20:07:36.629406 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 21 20:07:36.629406 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 20:07:36.629406 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 21 20:07:36.629406 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 20:07:36.629406 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 21 20:07:36.629406 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 21 20:07:36.629406 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 21 20:07:36.629406 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 21 20:07:36.629406 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 3a615f10-936f-48d1-aad9-e414dc31d016 while it is in vm_state rescued Jul 21 20:07:36.629406 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:07:36.629406 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:07:36.629406 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:07:36.629406 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:07:36.629406 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:07:36.629406 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:07:36.631449 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 20:07:36.631449 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 20:07:36.631449 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 3a615f10-936f-48d1-aad9-e414dc31d016 while it is in vm_state rescued Jul 21 20:07:36.631449 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:07:36.631449 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-f0c99cbb-7f43-4828-b6c3-da5142dd390b tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Returning 409 to user: Cannot 'attach_volume' instance 3a615f10-936f-48d1-aad9-e414dc31d016 while it is in vm_state rescued {{(pid=118344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 20:07:36.631449 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-f0c99cbb-7f43-4828-b6c3-da5142dd390b tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "POST /compute/v2.1/servers/3a615f10-936f-48d1-aad9-e414dc31d016/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.041101 Jul 21 20:07:36.632728 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 178/377] 10.222.0.58 () {60 vars in 1322 bytes} [Thu Jul 21 20:07:36 2022] POST /compute/v2.1/servers/3a615f10-936f-48d1-aad9-e414dc31d016/os-volume_attachments => generated 152 bytes in 46 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 21 20:07:36.640462 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-336333fd-d0fe-4b02-b8a4-e3f1092d8594 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:07:36.640948 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-336333fd-d0fe-4b02-b8a4-e3f1092d8594 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 3a615f10-936f-48d1-aad9-e414dc31d016] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:07:36.647408 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-336333fd-d0fe-4b02-b8a4-e3f1092d8594 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:07:36.647887 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-336333fd-d0fe-4b02-b8a4-e3f1092d8594 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:07:36.648731 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-336333fd-d0fe-4b02-b8a4-e3f1092d8594 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:07:36.649225 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-336333fd-d0fe-4b02-b8a4-e3f1092d8594 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:07:36.876634 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-336333fd-d0fe-4b02-b8a4-e3f1092d8594 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "POST /compute/v2.1/servers/3a615f10-936f-48d1-aad9-e414dc31d016/action" status: 202 len: 0 microversion: 2.1 time: 0.243241 Jul 21 20:07:36.878375 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 200/378] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Jul 21 20:07:36 2022] POST /compute/v2.1/servers/3a615f10-936f-48d1-aad9-e414dc31d016/action => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 21 20:07:36.891134 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-8a699eea-6c35-4dbd-8192-7dfd15979ab5 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:07:36.891742 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-8a699eea-6c35-4dbd-8192-7dfd15979ab5 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 3a615f10-936f-48d1-aad9-e414dc31d016] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:07:36.898266 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-8a699eea-6c35-4dbd-8192-7dfd15979ab5 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:07:36.898706 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-8a699eea-6c35-4dbd-8192-7dfd15979ab5 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:07:36.899515 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-8a699eea-6c35-4dbd-8192-7dfd15979ab5 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:07:36.899942 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-8a699eea-6c35-4dbd-8192-7dfd15979ab5 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:07:37.031462 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-8a699eea-6c35-4dbd-8192-7dfd15979ab5 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:07:37.040327 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-8a699eea-6c35-4dbd-8192-7dfd15979ab5 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/3a615f10-936f-48d1-aad9-e414dc31d016" status: 200 len: 1509 microversion: 2.1 time: 0.153505 Jul 21 20:07:37.040886 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 179/379] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:07:36 2022] GET /compute/v2.1/servers/3a615f10-936f-48d1-aad9-e414dc31d016 => generated 1509 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:07:38.058129 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-b69ad435-7b68-438c-95ff-db8eb75a5fbc tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:07:38.058916 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-b69ad435-7b68-438c-95ff-db8eb75a5fbc tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 3a615f10-936f-48d1-aad9-e414dc31d016] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:07:38.065662 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b69ad435-7b68-438c-95ff-db8eb75a5fbc tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:07:38.066200 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b69ad435-7b68-438c-95ff-db8eb75a5fbc tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:07:38.067104 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b69ad435-7b68-438c-95ff-db8eb75a5fbc tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:07:38.067630 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b69ad435-7b68-438c-95ff-db8eb75a5fbc tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:07:38.214810 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-b69ad435-7b68-438c-95ff-db8eb75a5fbc tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:07:38.223484 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-b69ad435-7b68-438c-95ff-db8eb75a5fbc tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/3a615f10-936f-48d1-aad9-e414dc31d016" status: 200 len: 1509 microversion: 2.1 time: 0.169536 Jul 21 20:07:38.224040 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 201/380] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:07:38 2022] GET /compute/v2.1/servers/3a615f10-936f-48d1-aad9-e414dc31d016 => generated 1509 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:07:39.243349 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-bd03cd44-5c7a-47dd-b675-324137a81df4 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:07:39.243876 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-bd03cd44-5c7a-47dd-b675-324137a81df4 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 3a615f10-936f-48d1-aad9-e414dc31d016] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:07:39.250431 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-bd03cd44-5c7a-47dd-b675-324137a81df4 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:07:39.250880 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-bd03cd44-5c7a-47dd-b675-324137a81df4 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:07:39.251718 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-bd03cd44-5c7a-47dd-b675-324137a81df4 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:07:39.252130 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-bd03cd44-5c7a-47dd-b675-324137a81df4 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:07:39.397805 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-bd03cd44-5c7a-47dd-b675-324137a81df4 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:07:39.405362 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-bd03cd44-5c7a-47dd-b675-324137a81df4 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/3a615f10-936f-48d1-aad9-e414dc31d016" status: 200 len: 1509 microversion: 2.1 time: 0.166727 Jul 21 20:07:39.405966 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 180/381] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:07:39 2022] GET /compute/v2.1/servers/3a615f10-936f-48d1-aad9-e414dc31d016 => generated 1509 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:07:40.425081 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-d47ecdfc-3b7e-4f89-9477-a700e49d62a7 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:07:40.425688 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-d47ecdfc-3b7e-4f89-9477-a700e49d62a7 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 3a615f10-936f-48d1-aad9-e414dc31d016] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:07:40.432375 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d47ecdfc-3b7e-4f89-9477-a700e49d62a7 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:07:40.432820 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d47ecdfc-3b7e-4f89-9477-a700e49d62a7 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:07:40.433582 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d47ecdfc-3b7e-4f89-9477-a700e49d62a7 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:07:40.434014 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d47ecdfc-3b7e-4f89-9477-a700e49d62a7 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:07:40.577256 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-d47ecdfc-3b7e-4f89-9477-a700e49d62a7 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:07:40.584885 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-d47ecdfc-3b7e-4f89-9477-a700e49d62a7 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/3a615f10-936f-48d1-aad9-e414dc31d016" status: 200 len: 1509 microversion: 2.1 time: 0.163648 Jul 21 20:07:40.585435 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 202/382] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:07:40 2022] GET /compute/v2.1/servers/3a615f10-936f-48d1-aad9-e414dc31d016 => generated 1509 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:07:41.604956 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-8b80b6d4-7d2c-4202-a822-7c431b34d9e6 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:07:41.604956 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-8b80b6d4-7d2c-4202-a822-7c431b34d9e6 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 3a615f10-936f-48d1-aad9-e414dc31d016] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:07:41.610162 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-8b80b6d4-7d2c-4202-a822-7c431b34d9e6 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:07:41.610617 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-8b80b6d4-7d2c-4202-a822-7c431b34d9e6 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:07:41.611463 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-8b80b6d4-7d2c-4202-a822-7c431b34d9e6 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:07:41.611931 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-8b80b6d4-7d2c-4202-a822-7c431b34d9e6 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:07:41.783190 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-8b80b6d4-7d2c-4202-a822-7c431b34d9e6 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:07:41.789325 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-8b80b6d4-7d2c-4202-a822-7c431b34d9e6 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/3a615f10-936f-48d1-aad9-e414dc31d016" status: 200 len: 1509 microversion: 2.1 time: 0.191466 Jul 21 20:07:41.789906 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 181/383] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:07:41 2022] GET /compute/v2.1/servers/3a615f10-936f-48d1-aad9-e414dc31d016 => generated 1509 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:07:42.806431 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-3aac051f-9b04-48e7-a0fe-34e9cb6d08c0 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:07:42.807158 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-3aac051f-9b04-48e7-a0fe-34e9cb6d08c0 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 3a615f10-936f-48d1-aad9-e414dc31d016] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:07:42.817412 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3aac051f-9b04-48e7-a0fe-34e9cb6d08c0 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:07:42.817855 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3aac051f-9b04-48e7-a0fe-34e9cb6d08c0 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:07:42.823624 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3aac051f-9b04-48e7-a0fe-34e9cb6d08c0 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:07:42.824069 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3aac051f-9b04-48e7-a0fe-34e9cb6d08c0 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:07:43.035576 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-3aac051f-9b04-48e7-a0fe-34e9cb6d08c0 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:07:43.045574 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-3aac051f-9b04-48e7-a0fe-34e9cb6d08c0 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/3a615f10-936f-48d1-aad9-e414dc31d016" status: 200 len: 1515 microversion: 2.1 time: 0.243657 Jul 21 20:07:43.058396 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 203/384] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:07:42 2022] GET /compute/v2.1/servers/3a615f10-936f-48d1-aad9-e414dc31d016 => generated 1515 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:07:46.228305 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-19ca44d8-20ca-4c99-8c58-20c10986964e tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Action: 'create', calling method: .version_select at 0x7f351d0f7550>, body: {"keypair": {"name": "tempest-keypair-1468934351", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPpncfCAbGJUWCMZHD4fDEWsk34SBv5+xCBoGGBw6P255/8ZLvh9pIffy1he7sS6/cOtYpuCWPBi8sy9Wb6ros5hDBet/TfkzdVo+1OaTjKncWAfe6M3vVHtBVcCPNqgZQ=="}} {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:07:46.247738 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.quota [None req-19ca44d8-20ca-4c99-8c58-20c10986964e tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Getting quotas for project 6d4acf1287ad4dac9bbf6dc27f427a7c. Resources: {'key_pairs'} {{(pid=118344) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 20:07:46.251830 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.quota [None req-19ca44d8-20ca-4c99-8c58-20c10986964e tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Getting quotas for user df9139f72d004b2fac1cba17647c129d and project 6d4acf1287ad4dac9bbf6dc27f427a7c. Resources: {'key_pairs'} {{(pid=118344) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 20:07:46.388630 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-19ca44d8-20ca-4c99-8c58-20c10986964e tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.166113 Jul 21 20:07:46.389545 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 182/385] 10.222.0.58 () {60 vars in 1158 bytes} [Thu Jul 21 20:07:46 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:07:49.401154 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-0bc5d96d-8f44-48b8-bece-700b1aa0d28d tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-392038242", "imageRef": "357a1479-6cbd-4882-8d3f-d945fa40e6df", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2a12064c-8c8d-4cc4-bf6b-339810e78e0e"}], "security_groups": [{"name": "tempest-securitygroup--2024599843"}], "key_name": "tempest-keypair-1468934351", "user_data": "}} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:07:49.562908 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.network.neutron [None req-0bc5d96d-8f44-48b8-bece-700b1aa0d28d tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] validate_networks() for [('2a12064c-8c8d-4cc4-bf6b-339810e78e0e', None, None, None, None, None)] {{(pid=118345) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 20:07:50.145755 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-0bc5d96d-8f44-48b8-bece-700b1aa0d28d tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Flavor limits 0:0:0 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 20:07:50.147008 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-0bc5d96d-8f44-48b8-bece-700b1aa0d28d tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Image limits 0:0:0 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 20:07:50.147569 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-0bc5d96d-8f44-48b8-bece-700b1aa0d28d tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Flavor pref 0:0:0 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 20:07:50.147936 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-0bc5d96d-8f44-48b8-bece-700b1aa0d28d tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Image pref 0:0:0 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 20:07:50.148441 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-0bc5d96d-8f44-48b8-bece-700b1aa0d28d tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 20:07:50.160406 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0bc5d96d-8f44-48b8-bece-700b1aa0d28d tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:07:50.163677 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0bc5d96d-8f44-48b8-bece-700b1aa0d28d tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:07:50.164553 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0bc5d96d-8f44-48b8-bece-700b1aa0d28d tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:07:50.175256 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0bc5d96d-8f44-48b8-bece-700b1aa0d28d tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:07:50.192279 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.quota [None req-0bc5d96d-8f44-48b8-bece-700b1aa0d28d tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Getting quotas for project 6d4acf1287ad4dac9bbf6dc27f427a7c. Resources: {'instances', 'cores', 'ram'} {{(pid=118345) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 20:07:50.197957 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.quota [None req-0bc5d96d-8f44-48b8-bece-700b1aa0d28d tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Getting quotas for user df9139f72d004b2fac1cba17647c129d and project 6d4acf1287ad4dac9bbf6dc27f427a7c. Resources: {'instances', 'cores', 'ram'} {{(pid=118345) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 20:07:50.216549 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-0bc5d96d-8f44-48b8-bece-700b1aa0d28d tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Going to run 1 instances... {{(pid=118345) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 20:07:50.216549 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-0bc5d96d-8f44-48b8-bece-700b1aa0d28d tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='357a1479-6cbd-4882-8d3f-d945fa40e6df',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118345) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 20:07:50.428591 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-0bc5d96d-8f44-48b8-bece-700b1aa0d28d tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.032431 Jul 21 20:07:50.430094 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 204/386] 10.222.0.58 () {60 vars in 1146 bytes} [Thu Jul 21 20:07:49 2022] POST /compute/v2.1/servers => generated 409 bytes in 1035 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 20:07:50.440998 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-fe15e5a9-f3e5-468c-83fb-fb4897591bb3 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:07:50.441825 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-fe15e5a9-f3e5-468c-83fb-fb4897591bb3 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:07:50.520870 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-fe15e5a9-f3e5-468c-83fb-fb4897591bb3 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:07:50.532323 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-fe15e5a9-f3e5-468c-83fb-fb4897591bb3 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6" status: 200 len: 1245 microversion: 2.1 time: 0.095836 Jul 21 20:07:50.537164 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 183/387] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:07:50 2022] GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6 => generated 1245 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:07:51.552908 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-5320e888-d7a8-4deb-bf7a-5542b0248328 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:07:51.554231 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-5320e888-d7a8-4deb-bf7a-5542b0248328 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:07:51.651284 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-5320e888-d7a8-4deb-bf7a-5542b0248328 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:07:51.660656 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-5320e888-d7a8-4deb-bf7a-5542b0248328 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6" status: 200 len: 1245 microversion: 2.1 time: 0.111753 Jul 21 20:07:51.661501 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 205/388] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:07:51 2022] GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6 => generated 1245 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:07:52.678826 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-61e190c4-2824-4b3b-ae5f-3e91162cd144 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:07:52.680588 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-61e190c4-2824-4b3b-ae5f-3e91162cd144 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:07:52.683476 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG dbcounter [-] [118344] Writing DB stats nova_cell1:SELECT=21 {{(pid=118344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:07:52.684464 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG dbcounter [-] [118344] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=118344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:07:52.689770 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-61e190c4-2824-4b3b-ae5f-3e91162cd144 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:07:52.690889 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-61e190c4-2824-4b3b-ae5f-3e91162cd144 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:07:52.692009 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-61e190c4-2824-4b3b-ae5f-3e91162cd144 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:07:52.692664 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-61e190c4-2824-4b3b-ae5f-3e91162cd144 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:07:52.952745 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-61e190c4-2824-4b3b-ae5f-3e91162cd144 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:07:52.960880 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-61e190c4-2824-4b3b-ae5f-3e91162cd144 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6" status: 200 len: 1241 microversion: 2.1 time: 0.286612 Jul 21 20:07:52.961461 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 184/389] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:07:52 2022] GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6 => generated 1241 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:07:53.979157 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-a02b2927-31a1-415f-b6ef-e77c2b617b4d tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:07:53.979872 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-a02b2927-31a1-415f-b6ef-e77c2b617b4d tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:07:53.986200 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a02b2927-31a1-415f-b6ef-e77c2b617b4d tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:07:53.986664 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a02b2927-31a1-415f-b6ef-e77c2b617b4d tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:07:53.987991 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a02b2927-31a1-415f-b6ef-e77c2b617b4d tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:07:53.987991 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a02b2927-31a1-415f-b6ef-e77c2b617b4d tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:07:54.081745 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-a02b2927-31a1-415f-b6ef-e77c2b617b4d tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:07:54.092284 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-a02b2927-31a1-415f-b6ef-e77c2b617b4d tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6" status: 200 len: 1305 microversion: 2.1 time: 0.117068 Jul 21 20:07:54.094419 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 206/390] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:07:53 2022] GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6 => generated 1305 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:07:55.115362 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-3fb69649-9e85-4f85-9b60-6d1bf5a5a3ef tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:07:55.117434 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-3fb69649-9e85-4f85-9b60-6d1bf5a5a3ef tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:07:55.130705 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-3fb69649-9e85-4f85-9b60-6d1bf5a5a3ef tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:07:55.131177 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-3fb69649-9e85-4f85-9b60-6d1bf5a5a3ef tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:07:55.132163 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-3fb69649-9e85-4f85-9b60-6d1bf5a5a3ef tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:07:55.132745 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-3fb69649-9e85-4f85-9b60-6d1bf5a5a3ef tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:07:55.329417 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-3fb69649-9e85-4f85-9b60-6d1bf5a5a3ef tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:07:55.337838 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-3fb69649-9e85-4f85-9b60-6d1bf5a5a3ef tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6" status: 200 len: 1371 microversion: 2.1 time: 0.231748 Jul 21 20:07:55.338427 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 185/391] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:07:55 2022] GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6 => generated 1371 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:07:56.076858 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [req-29355c0c-5f97-468a-b889-a5513698a51b req-16bf709d-9158-49d4-980f-631958a19ce0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6", "tag": "2c53b026-bf56-4c64-b42c-bad40f216602"}]} {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:07:56.096749 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [req-29355c0c-5f97-468a-b889-a5513698a51b req-16bf709d-9158-49d4-980f-631958a19ce0 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:07:56.097191 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [req-29355c0c-5f97-468a-b889-a5513698a51b req-16bf709d-9158-49d4-980f-631958a19ce0 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:07:56.111931 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.compute.server_external_events [req-29355c0c-5f97-468a-b889-a5513698a51b req-16bf709d-9158-49d4-980f-631958a19ce0 service nova] Creating event network-changed:2c53b026-bf56-4c64-b42c-bad40f216602 for instance 5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6 on hv-cinder-85054 Jul 21 20:07:56.122483 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [req-29355c0c-5f97-468a-b889-a5513698a51b req-16bf709d-9158-49d4-980f-631958a19ce0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056684 Jul 21 20:07:56.124296 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 186/392] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 20:07:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:07:56.269372 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-feeee891-5638-4a46-8789-618285265489 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Action: 'create', calling method: .version_select at 0x7f351cea0b80>, body: {"keypair": {"name": "tempest-TestShelveInstance-1680681615", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC7lbe9Bh4hX+K1g1UOQ9POrQoBiK0V7qZTjp2OLOTj4d1ffzCiK5vN6/hoFdgXiYaNNZdXjRBBMK8Ee1Le0G7tT1yBPwW8+ZYJOx/F+Xhi73qh4UgCK06f6eTxmyc9geg=="}} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:07:56.295850 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.quota [None req-feeee891-5638-4a46-8789-618285265489 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Getting quotas for project 4239f4ae39bb49cf8063377a93875456. Resources: {'key_pairs'} {{(pid=118345) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 20:07:56.307492 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.quota [None req-feeee891-5638-4a46-8789-618285265489 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Getting quotas for user 4bf78e0fe86d4e078c0527248af45cb4 and project 4239f4ae39bb49cf8063377a93875456. Resources: {'key_pairs'} {{(pid=118345) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 20:07:56.324842 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR oslo.messaging._drivers.impl_rabbit [None req-feeee891-5638-4a46-8789-618285265489 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] [08cd2d4c-c48c-42cc-b92d-9650e32dd96c] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 21 20:07:56.357530 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-0dd03426-e6ff-498d-a051-976f7af881f3 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:07:56.358377 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-0dd03426-e6ff-498d-a051-976f7af881f3 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:07:56.365658 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-0dd03426-e6ff-498d-a051-976f7af881f3 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:07:56.366187 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-0dd03426-e6ff-498d-a051-976f7af881f3 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:07:56.366971 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-0dd03426-e6ff-498d-a051-976f7af881f3 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:07:56.367648 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-0dd03426-e6ff-498d-a051-976f7af881f3 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:07:56.548020 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-0dd03426-e6ff-498d-a051-976f7af881f3 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:07:56.561444 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-0dd03426-e6ff-498d-a051-976f7af881f3 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6" status: 200 len: 1371 microversion: 2.1 time: 0.209027 Jul 21 20:07:56.562029 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 187/393] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:07:56 2022] GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6 => generated 1371 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:07:57.332316 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO oslo.messaging._drivers.impl_rabbit [None req-feeee891-5638-4a46-8789-618285265489 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] [08cd2d4c-c48c-42cc-b92d-9650e32dd96c] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 36280. Jul 21 20:07:57.577816 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-feeee891-5638-4a46-8789-618285265489 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 1.593079 Jul 21 20:07:57.578577 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-dc0ee78a-bce4-4466-9edb-133e8870f770 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:07:57.579176 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 207/394] 10.222.0.58 () {60 vars in 1158 bytes} [Thu Jul 21 20:07:55 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 1595 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:07:57.579265 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-dc0ee78a-bce4-4466-9edb-133e8870f770 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:07:57.586517 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-dc0ee78a-bce4-4466-9edb-133e8870f770 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:07:57.587075 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-dc0ee78a-bce4-4466-9edb-133e8870f770 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:07:57.587915 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-dc0ee78a-bce4-4466-9edb-133e8870f770 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:07:57.588418 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-dc0ee78a-bce4-4466-9edb-133e8870f770 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:07:57.734894 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-dc0ee78a-bce4-4466-9edb-133e8870f770 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:07:57.746066 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-dc0ee78a-bce4-4466-9edb-133e8870f770 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6" status: 200 len: 1371 microversion: 2.1 time: 0.171882 Jul 21 20:07:57.747771 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 188/395] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:07:57 2022] GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6 => generated 1371 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:07:58.765073 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-f02deacc-346e-4ed7-ae63-6743f51d35f4 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:07:58.765689 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-f02deacc-346e-4ed7-ae63-6743f51d35f4 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:07:58.773102 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f02deacc-346e-4ed7-ae63-6743f51d35f4 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:07:58.773551 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f02deacc-346e-4ed7-ae63-6743f51d35f4 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:07:58.774323 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f02deacc-346e-4ed7-ae63-6743f51d35f4 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:07:58.774749 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f02deacc-346e-4ed7-ae63-6743f51d35f4 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:07:58.993830 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-f02deacc-346e-4ed7-ae63-6743f51d35f4 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:07:59.001067 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-f02deacc-346e-4ed7-ae63-6743f51d35f4 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6" status: 200 len: 1371 microversion: 2.1 time: 0.240211 Jul 21 20:07:59.011181 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 208/396] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:07:58 2022] GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6 => generated 1371 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:08:00.024917 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-533924f9-4d67-4eb2-b304-faf6d6d1dc3f tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:08:00.024917 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-533924f9-4d67-4eb2-b304-faf6d6d1dc3f tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:08:00.029330 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-533924f9-4d67-4eb2-b304-faf6d6d1dc3f tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:08:00.029780 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-533924f9-4d67-4eb2-b304-faf6d6d1dc3f tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:08:00.030618 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-533924f9-4d67-4eb2-b304-faf6d6d1dc3f tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:08:00.031084 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-533924f9-4d67-4eb2-b304-faf6d6d1dc3f tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:08:00.192709 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-533924f9-4d67-4eb2-b304-faf6d6d1dc3f tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:08:00.200618 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-533924f9-4d67-4eb2-b304-faf6d6d1dc3f tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6" status: 200 len: 1371 microversion: 2.1 time: 0.183393 Jul 21 20:08:00.201195 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 189/397] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:08:00 2022] GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6 => generated 1371 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:08:01.222617 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-b615b987-6ec6-4a69-a6e6-79d21be062a3 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:08:01.222617 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-b615b987-6ec6-4a69-a6e6-79d21be062a3 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:08:01.222617 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell0:SELECT=2 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:08:01.230660 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b615b987-6ec6-4a69-a6e6-79d21be062a3 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:08:01.231127 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b615b987-6ec6-4a69-a6e6-79d21be062a3 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:08:01.231893 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b615b987-6ec6-4a69-a6e6-79d21be062a3 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:08:01.232318 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b615b987-6ec6-4a69-a6e6-79d21be062a3 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:08:01.373752 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-b615b987-6ec6-4a69-a6e6-79d21be062a3 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:08:01.381053 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-b615b987-6ec6-4a69-a6e6-79d21be062a3 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6" status: 200 len: 1371 microversion: 2.1 time: 0.167298 Jul 21 20:08:01.381685 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 209/398] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:08:01 2022] GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6 => generated 1371 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:08:02.398373 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-c7de243a-fa0b-411a-b899-a34213ee0e3a tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:08:02.398980 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-c7de243a-fa0b-411a-b899-a34213ee0e3a tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:08:02.401190 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG dbcounter [-] [118344] Writing DB stats nova_cell0:SELECT=6 {{(pid=118344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:08:02.405994 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-c7de243a-fa0b-411a-b899-a34213ee0e3a tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:08:02.406484 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-c7de243a-fa0b-411a-b899-a34213ee0e3a tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:08:02.407310 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-c7de243a-fa0b-411a-b899-a34213ee0e3a tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:08:02.407754 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-c7de243a-fa0b-411a-b899-a34213ee0e3a tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:08:02.535918 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-c7de243a-fa0b-411a-b899-a34213ee0e3a tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:08:02.543522 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-c7de243a-fa0b-411a-b899-a34213ee0e3a tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6" status: 200 len: 1371 microversion: 2.1 time: 0.149606 Jul 21 20:08:02.544085 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 190/399] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:08:02 2022] GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6 => generated 1371 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:08:03.166206 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [req-00155a31-8031-43e5-9efe-aff7356476fd req-8ef6e628-9769-4279-a0b6-db97282659ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6", "name": "network-vif-plugged", "status": "completed", "tag": "2c53b026-bf56-4c64-b42c-bad40f216602"}]} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:08:03.169591 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=4 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:08:03.174796 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-00155a31-8031-43e5-9efe-aff7356476fd req-8ef6e628-9769-4279-a0b6-db97282659ee service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:08:03.175322 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-00155a31-8031-43e5-9efe-aff7356476fd req-8ef6e628-9769-4279-a0b6-db97282659ee service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:08:03.179575 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:08:03.188185 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.compute.server_external_events [req-00155a31-8031-43e5-9efe-aff7356476fd req-8ef6e628-9769-4279-a0b6-db97282659ee service nova] Creating event network-vif-plugged:2c53b026-bf56-4c64-b42c-bad40f216602 for instance 5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6 on hv-cinder-85054 Jul 21 20:08:03.193432 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [req-00155a31-8031-43e5-9efe-aff7356476fd req-8ef6e628-9769-4279-a0b6-db97282659ee service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031276 Jul 21 20:08:03.194224 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 210/400] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 20:08:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:08:03.561113 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-4db888b6-5422-4345-8eef-f4b524cb0ded tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:08:03.561656 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-4db888b6-5422-4345-8eef-f4b524cb0ded tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:08:03.568999 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-4db888b6-5422-4345-8eef-f4b524cb0ded tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:08:03.569450 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-4db888b6-5422-4345-8eef-f4b524cb0ded tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:08:03.570220 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-4db888b6-5422-4345-8eef-f4b524cb0ded tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:08:03.570669 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-4db888b6-5422-4345-8eef-f4b524cb0ded tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:08:03.708941 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-4db888b6-5422-4345-8eef-f4b524cb0ded tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:08:03.717177 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-4db888b6-5422-4345-8eef-f4b524cb0ded tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6" status: 200 len: 1371 microversion: 2.1 time: 0.160081 Jul 21 20:08:03.717747 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 191/401] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:08:03 2022] GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6 => generated 1371 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:08:04.736309 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-649ac37e-5069-462d-9ceb-8047b2efa875 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:08:04.737201 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-649ac37e-5069-462d-9ceb-8047b2efa875 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:08:04.746534 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-649ac37e-5069-462d-9ceb-8047b2efa875 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:08:04.746961 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-649ac37e-5069-462d-9ceb-8047b2efa875 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:08:04.747802 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-649ac37e-5069-462d-9ceb-8047b2efa875 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:08:04.748340 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-649ac37e-5069-462d-9ceb-8047b2efa875 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:08:04.879734 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-649ac37e-5069-462d-9ceb-8047b2efa875 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:08:04.887055 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-649ac37e-5069-462d-9ceb-8047b2efa875 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6" status: 200 len: 1371 microversion: 2.1 time: 0.155588 Jul 21 20:08:04.887652 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 211/402] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:08:04 2022] GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6 => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:08:05.904360 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-e6f79e61-42a0-46d2-b71b-114c7a868630 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:08:05.904980 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-e6f79e61-42a0-46d2-b71b-114c7a868630 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:08:05.911552 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-e6f79e61-42a0-46d2-b71b-114c7a868630 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:08:05.915844 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-e6f79e61-42a0-46d2-b71b-114c7a868630 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:08:05.915844 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-e6f79e61-42a0-46d2-b71b-114c7a868630 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:08:05.915844 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-e6f79e61-42a0-46d2-b71b-114c7a868630 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:08:06.044413 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-e6f79e61-42a0-46d2-b71b-114c7a868630 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:08:06.051841 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-e6f79e61-42a0-46d2-b71b-114c7a868630 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6" status: 200 len: 1371 microversion: 2.1 time: 0.151498 Jul 21 20:08:06.052610 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 192/403] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:08:05 2022] GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6 => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:08:07.069281 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-f5dc640c-28c0-4faf-9a29-bb42bd92399c tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:08:07.069840 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-f5dc640c-28c0-4faf-9a29-bb42bd92399c tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:08:07.071782 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell0:SELECT=12 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:08:07.076735 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f5dc640c-28c0-4faf-9a29-bb42bd92399c tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:08:07.077177 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f5dc640c-28c0-4faf-9a29-bb42bd92399c tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:08:07.077931 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f5dc640c-28c0-4faf-9a29-bb42bd92399c tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:08:07.078362 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f5dc640c-28c0-4faf-9a29-bb42bd92399c tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:08:07.212365 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-f5dc640c-28c0-4faf-9a29-bb42bd92399c tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:08:07.220061 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-f5dc640c-28c0-4faf-9a29-bb42bd92399c tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6" status: 200 len: 1566 microversion: 2.1 time: 0.155113 Jul 21 20:08:07.220710 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 212/404] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:08:07 2022] GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:08:07.238417 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-f9143485-30fc-4982-b532-1e4bf7912168 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:08:07.238955 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-f9143485-30fc-4982-b532-1e4bf7912168 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:08:07.246487 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f9143485-30fc-4982-b532-1e4bf7912168 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:08:07.248424 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f9143485-30fc-4982-b532-1e4bf7912168 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:08:07.248424 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f9143485-30fc-4982-b532-1e4bf7912168 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:08:07.248424 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f9143485-30fc-4982-b532-1e4bf7912168 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:08:07.325043 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-f9143485-30fc-4982-b532-1e4bf7912168 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090505 Jul 21 20:08:07.325717 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 193/405] 10.222.0.58 () {58 vars in 1274 bytes} [Thu Jul 21 20:08:07 2022] GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:08:08.357572 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [req-1128e08a-f407-4a15-aa8a-284cf087410f req-5789ca0f-741d-48e4-89bd-4d8ade4b72a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6", "tag": "2c53b026-bf56-4c64-b42c-bad40f216602"}]} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:08:08.367911 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-1128e08a-f407-4a15-aa8a-284cf087410f req-5789ca0f-741d-48e4-89bd-4d8ade4b72a9 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:08:08.368409 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-1128e08a-f407-4a15-aa8a-284cf087410f req-5789ca0f-741d-48e4-89bd-4d8ade4b72a9 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:08:08.380341 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.compute.server_external_events [req-1128e08a-f407-4a15-aa8a-284cf087410f req-5789ca0f-741d-48e4-89bd-4d8ade4b72a9 service nova] Creating event network-changed:2c53b026-bf56-4c64-b42c-bad40f216602 for instance 5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6 on hv-cinder-85054 Jul 21 20:08:08.386062 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [req-1128e08a-f407-4a15-aa8a-284cf087410f req-5789ca0f-741d-48e4-89bd-4d8ade4b72a9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032150 Jul 21 20:08:08.386864 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 213/406] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 20:08:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:08:22.840049 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 20:08:22.840600 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Thu Jul 21 20:08:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 20:08:28.362829 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG dbcounter [-] [118344] Writing DB stats nova_api:SELECT=19 {{(pid=118344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:08:28.367199 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG dbcounter [-] [118344] Writing DB stats nova_cell1:SELECT=54 {{(pid=118344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:08:28.367535 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-e891cd43-59cd-493c-8498-84ddd5f76b56 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1433872710", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1680681615", "security_groups": [{"name": "tempest-secgroup-smoke-1166333719"}], "networks": [{"uuid": "6c1969ea-9718-4521-aa37-d5bda3c49827"}], "block_device_mapping_v2": [{"uuid": "23a8f8f2-02d9-4b78-8397-0c4823ce895b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:08:28.480830 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.network.neutron [None req-e891cd43-59cd-493c-8498-84ddd5f76b56 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] validate_networks() for [('6c1969ea-9718-4521-aa37-d5bda3c49827', None, None, None, None, None)] {{(pid=118344) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 20:08:28.841471 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.virt.hardware [None req-e891cd43-59cd-493c-8498-84ddd5f76b56 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Flavor limits 0:0:0 {{(pid=118344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 20:08:28.841914 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.virt.hardware [None req-e891cd43-59cd-493c-8498-84ddd5f76b56 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Image limits 0:0:0 {{(pid=118344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 20:08:28.842385 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.virt.hardware [None req-e891cd43-59cd-493c-8498-84ddd5f76b56 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Flavor pref 0:0:0 {{(pid=118344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 20:08:28.842908 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.virt.hardware [None req-e891cd43-59cd-493c-8498-84ddd5f76b56 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Image pref 0:0:0 {{(pid=118344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 20:08:28.843481 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.virt.hardware [None req-e891cd43-59cd-493c-8498-84ddd5f76b56 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 20:08:28.853512 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-e891cd43-59cd-493c-8498-84ddd5f76b56 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:08:28.853955 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-e891cd43-59cd-493c-8498-84ddd5f76b56 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:08:28.854754 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-e891cd43-59cd-493c-8498-84ddd5f76b56 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:08:28.855215 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-e891cd43-59cd-493c-8498-84ddd5f76b56 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:08:28.874414 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.quota [None req-e891cd43-59cd-493c-8498-84ddd5f76b56 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Getting quotas for project 4239f4ae39bb49cf8063377a93875456. Resources: {'instances', 'cores', 'ram'} {{(pid=118344) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 20:08:28.878503 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.quota [None req-e891cd43-59cd-493c-8498-84ddd5f76b56 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Getting quotas for user 4bf78e0fe86d4e078c0527248af45cb4 and project 4239f4ae39bb49cf8063377a93875456. Resources: {'instances', 'cores', 'ram'} {{(pid=118344) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 20:08:28.938183 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-e891cd43-59cd-493c-8498-84ddd5f76b56 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Going to run 1 instances... {{(pid=118344) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 20:08:28.940385 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-e891cd43-59cd-493c-8498-84ddd5f76b56 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] [instance: 301ed3ad-5cb4-4ebf-ac32-519ab482cdea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='23a8f8f2-02d9-4b78-8397-0c4823ce895b',volume_size=None,volume_type=None)] {{(pid=118344) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 20:08:29.373246 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-e891cd43-59cd-493c-8498-84ddd5f76b56 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.011680 Jul 21 20:08:29.373928 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 194/407] 10.222.0.58 () {60 vars in 1146 bytes} [Thu Jul 21 20:08:28 2022] POST /compute/v2.1/servers => generated 406 bytes in 1013 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 20:08:29.385476 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-46e3cef9-b9ca-43da-a9bc-743747b9187b tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:08:29.386192 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-46e3cef9-b9ca-43da-a9bc-743747b9187b tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] [instance: 301ed3ad-5cb4-4ebf-ac32-519ab482cdea] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:08:29.390293 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_api:SELECT=7 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:08:29.390959 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell1:SELECT=15 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:08:29.443134 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-46e3cef9-b9ca-43da-a9bc-743747b9187b tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf78e0fe86d4e078c0527248af45cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4239f4ae39bb49cf8063377a93875456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:08:29.450772 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-46e3cef9-b9ca-43da-a9bc-743747b9187b tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] 10.222.0.58 "GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea" status: 200 len: 1089 microversion: 2.1 time: 0.069363 Jul 21 20:08:29.453228 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 214/408] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:08:29 2022] GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea => generated 1089 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:08:30.469211 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-9d9bc0b5-f845-4c0e-a662-952a52fc398a tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:08:30.469825 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-9d9bc0b5-f845-4c0e-a662-952a52fc398a tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] [instance: 301ed3ad-5cb4-4ebf-ac32-519ab482cdea] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:08:30.476666 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-9d9bc0b5-f845-4c0e-a662-952a52fc398a tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:08:30.477109 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-9d9bc0b5-f845-4c0e-a662-952a52fc398a tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:08:30.477874 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-9d9bc0b5-f845-4c0e-a662-952a52fc398a tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:08:30.478311 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-9d9bc0b5-f845-4c0e-a662-952a52fc398a tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:08:30.541610 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-9d9bc0b5-f845-4c0e-a662-952a52fc398a tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf78e0fe86d4e078c0527248af45cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4239f4ae39bb49cf8063377a93875456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:08:30.549230 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-9d9bc0b5-f845-4c0e-a662-952a52fc398a tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] 10.222.0.58 "GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea" status: 200 len: 1139 microversion: 2.1 time: 0.085190 Jul 21 20:08:30.549788 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 195/409] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:08:30 2022] GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea => generated 1139 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:08:31.566746 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-100c42ff-1010-40ad-8791-7498a614ffb2 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:08:31.567407 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-100c42ff-1010-40ad-8791-7498a614ffb2 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] [instance: 301ed3ad-5cb4-4ebf-ac32-519ab482cdea] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:08:31.574010 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-100c42ff-1010-40ad-8791-7498a614ffb2 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:08:31.575043 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-100c42ff-1010-40ad-8791-7498a614ffb2 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:08:31.575822 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-100c42ff-1010-40ad-8791-7498a614ffb2 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:08:31.576255 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-100c42ff-1010-40ad-8791-7498a614ffb2 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:08:31.638275 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-100c42ff-1010-40ad-8791-7498a614ffb2 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf78e0fe86d4e078c0527248af45cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4239f4ae39bb49cf8063377a93875456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:08:31.646152 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-100c42ff-1010-40ad-8791-7498a614ffb2 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] 10.222.0.58 "GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea" status: 200 len: 1187 microversion: 2.1 time: 0.083006 Jul 21 20:08:31.646423 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 215/410] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:08:31 2022] GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea => generated 1187 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:08:32.663552 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-0313f47b-8cfa-43a8-8df3-9d049c5b3999 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:08:32.664157 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-0313f47b-8cfa-43a8-8df3-9d049c5b3999 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] [instance: 301ed3ad-5cb4-4ebf-ac32-519ab482cdea] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:08:32.670176 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-0313f47b-8cfa-43a8-8df3-9d049c5b3999 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:08:32.675303 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-0313f47b-8cfa-43a8-8df3-9d049c5b3999 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:08:32.675303 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-0313f47b-8cfa-43a8-8df3-9d049c5b3999 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:08:32.675303 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-0313f47b-8cfa-43a8-8df3-9d049c5b3999 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:08:32.807960 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-0313f47b-8cfa-43a8-8df3-9d049c5b3999 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf78e0fe86d4e078c0527248af45cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4239f4ae39bb49cf8063377a93875456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:08:32.820357 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-0313f47b-8cfa-43a8-8df3-9d049c5b3999 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] 10.222.0.58 "GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea" status: 200 len: 1273 microversion: 2.1 time: 0.156652 Jul 21 20:08:32.821008 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 196/411] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:08:32 2022] GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea => generated 1273 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:08:33.728638 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [req-03421e06-d677-49b2-aef2-fe0d9e2d7d37 req-18ed397f-0d33-41e0-ae4b-8ee504ee2ce5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "301ed3ad-5cb4-4ebf-ac32-519ab482cdea", "tag": "4300c7df-3693-4c3f-ae64-d9d267e9d57d"}]} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:08:33.737464 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-03421e06-d677-49b2-aef2-fe0d9e2d7d37 req-18ed397f-0d33-41e0-ae4b-8ee504ee2ce5 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:08:33.738194 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-03421e06-d677-49b2-aef2-fe0d9e2d7d37 req-18ed397f-0d33-41e0-ae4b-8ee504ee2ce5 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:08:33.749485 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.compute.server_external_events [req-03421e06-d677-49b2-aef2-fe0d9e2d7d37 req-18ed397f-0d33-41e0-ae4b-8ee504ee2ce5 service nova] Creating event network-changed:4300c7df-3693-4c3f-ae64-d9d267e9d57d for instance 301ed3ad-5cb4-4ebf-ac32-519ab482cdea on hv-cinder-85054 Jul 21 20:08:33.756514 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [req-03421e06-d677-49b2-aef2-fe0d9e2d7d37 req-18ed397f-0d33-41e0-ae4b-8ee504ee2ce5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033612 Jul 21 20:08:33.757128 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 216/412] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 20:08:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:08:33.841571 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-cdb75277-c8b6-4a0f-9702-8331336859b2 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:08:33.842175 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-cdb75277-c8b6-4a0f-9702-8331336859b2 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] [instance: 301ed3ad-5cb4-4ebf-ac32-519ab482cdea] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:08:33.850994 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-cdb75277-c8b6-4a0f-9702-8331336859b2 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:08:33.851730 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-cdb75277-c8b6-4a0f-9702-8331336859b2 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:08:33.852515 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-cdb75277-c8b6-4a0f-9702-8331336859b2 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:08:33.852958 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-cdb75277-c8b6-4a0f-9702-8331336859b2 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:08:33.995107 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-cdb75277-c8b6-4a0f-9702-8331336859b2 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf78e0fe86d4e078c0527248af45cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4239f4ae39bb49cf8063377a93875456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:08:34.002736 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-cdb75277-c8b6-4a0f-9702-8331336859b2 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] 10.222.0.58 "GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea" status: 200 len: 1261 microversion: 2.1 time: 0.165944 Jul 21 20:08:34.003339 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 197/413] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:08:33 2022] GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea => generated 1261 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:08:35.020169 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-a294c3cd-f14a-438d-b772-2aa5093f034f tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:08:35.020775 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-a294c3cd-f14a-438d-b772-2aa5093f034f tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] [instance: 301ed3ad-5cb4-4ebf-ac32-519ab482cdea] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:08:35.027086 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a294c3cd-f14a-438d-b772-2aa5093f034f tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:08:35.027531 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a294c3cd-f14a-438d-b772-2aa5093f034f tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:08:35.028286 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a294c3cd-f14a-438d-b772-2aa5093f034f tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:08:35.028716 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a294c3cd-f14a-438d-b772-2aa5093f034f tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:08:35.163929 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-a294c3cd-f14a-438d-b772-2aa5093f034f tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf78e0fe86d4e078c0527248af45cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4239f4ae39bb49cf8063377a93875456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:08:35.173486 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-a294c3cd-f14a-438d-b772-2aa5093f034f tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] 10.222.0.58 "GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea" status: 200 len: 1261 microversion: 2.1 time: 0.157556 Jul 21 20:08:35.174179 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 217/414] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:08:35 2022] GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea => generated 1261 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:08:36.192353 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-3ab66511-6897-4343-94b3-805572e9c627 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:08:36.193012 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-3ab66511-6897-4343-94b3-805572e9c627 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] [instance: 301ed3ad-5cb4-4ebf-ac32-519ab482cdea] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:08:36.200055 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-3ab66511-6897-4343-94b3-805572e9c627 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:08:36.200503 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-3ab66511-6897-4343-94b3-805572e9c627 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:08:36.201263 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-3ab66511-6897-4343-94b3-805572e9c627 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:08:36.201699 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-3ab66511-6897-4343-94b3-805572e9c627 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:08:36.330252 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-3ab66511-6897-4343-94b3-805572e9c627 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf78e0fe86d4e078c0527248af45cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4239f4ae39bb49cf8063377a93875456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:08:36.338328 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-3ab66511-6897-4343-94b3-805572e9c627 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] 10.222.0.58 "GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea" status: 200 len: 1261 microversion: 2.1 time: 0.149880 Jul 21 20:08:36.338988 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 198/415] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:08:36 2022] GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea => generated 1261 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:08:37.356350 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-e335e91f-09c0-4894-92c2-cf74688cd498 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:08:37.356961 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-e335e91f-09c0-4894-92c2-cf74688cd498 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] [instance: 301ed3ad-5cb4-4ebf-ac32-519ab482cdea] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:08:37.362931 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e335e91f-09c0-4894-92c2-cf74688cd498 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:08:37.363415 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e335e91f-09c0-4894-92c2-cf74688cd498 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:08:37.364174 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e335e91f-09c0-4894-92c2-cf74688cd498 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:08:37.364604 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e335e91f-09c0-4894-92c2-cf74688cd498 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:08:37.492654 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-e335e91f-09c0-4894-92c2-cf74688cd498 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf78e0fe86d4e078c0527248af45cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4239f4ae39bb49cf8063377a93875456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:08:37.500567 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-e335e91f-09c0-4894-92c2-cf74688cd498 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] 10.222.0.58 "GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea" status: 200 len: 1261 microversion: 2.1 time: 0.148200 Jul 21 20:08:37.501126 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 218/416] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:08:37 2022] GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea => generated 1261 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:08:38.517283 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-393c268f-5fd6-4cf5-97cc-7113bda54f55 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:08:38.517897 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-393c268f-5fd6-4cf5-97cc-7113bda54f55 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] [instance: 301ed3ad-5cb4-4ebf-ac32-519ab482cdea] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:08:38.524579 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-393c268f-5fd6-4cf5-97cc-7113bda54f55 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:08:38.525026 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-393c268f-5fd6-4cf5-97cc-7113bda54f55 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:08:38.525789 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-393c268f-5fd6-4cf5-97cc-7113bda54f55 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:08:38.526225 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-393c268f-5fd6-4cf5-97cc-7113bda54f55 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:08:38.657160 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-393c268f-5fd6-4cf5-97cc-7113bda54f55 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf78e0fe86d4e078c0527248af45cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4239f4ae39bb49cf8063377a93875456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:08:38.664847 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-393c268f-5fd6-4cf5-97cc-7113bda54f55 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] 10.222.0.58 "GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea" status: 200 len: 1261 microversion: 2.1 time: 0.151452 Jul 21 20:08:38.665594 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 199/417] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:08:38 2022] GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea => generated 1261 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:08:39.680950 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-20272602-4946-4abf-a6f3-69ce09877077 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:08:39.681564 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-20272602-4946-4abf-a6f3-69ce09877077 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] [instance: 301ed3ad-5cb4-4ebf-ac32-519ab482cdea] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:08:39.684114 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell0:SELECT=2 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:08:39.688895 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-20272602-4946-4abf-a6f3-69ce09877077 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:08:39.689332 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-20272602-4946-4abf-a6f3-69ce09877077 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:08:39.695524 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-20272602-4946-4abf-a6f3-69ce09877077 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:08:39.695524 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-20272602-4946-4abf-a6f3-69ce09877077 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:08:39.825654 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-20272602-4946-4abf-a6f3-69ce09877077 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf78e0fe86d4e078c0527248af45cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4239f4ae39bb49cf8063377a93875456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:08:39.833103 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-20272602-4946-4abf-a6f3-69ce09877077 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] 10.222.0.58 "GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea" status: 200 len: 1261 microversion: 2.1 time: 0.155972 Jul 21 20:08:39.833658 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 219/418] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:08:39 2022] GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea => generated 1261 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:08:40.641381 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-c88228e4-28d9-4843-877e-90dfa363f105 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:08:40.641899 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-c88228e4-28d9-4843-877e-90dfa363f105 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 8f00566b-862b-4171-9259-b12aaa7ea030] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:08:40.643717 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG dbcounter [-] [118344] Writing DB stats nova_cell0:SELECT=2 {{(pid=118344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:08:40.644397 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG dbcounter [-] [118344] Writing DB stats nova_cell0:SELECT=6 {{(pid=118344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:08:40.649886 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-c88228e4-28d9-4843-877e-90dfa363f105 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:08:40.650338 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-c88228e4-28d9-4843-877e-90dfa363f105 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:08:40.651216 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-c88228e4-28d9-4843-877e-90dfa363f105 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:08:40.651661 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-c88228e4-28d9-4843-877e-90dfa363f105 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:08:40.674504 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-c88228e4-28d9-4843-877e-90dfa363f105 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030/ips" status: 200 len: 150 microversion: 2.1 time: 0.037185 Jul 21 20:08:40.675077 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 200/419] 10.222.0.58 () {58 vars in 1247 bytes} [Thu Jul 21 20:08:40 2022] GET /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:08:40.849379 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-ebcf21b8-34ca-4470-8c15-0a382de56493 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:08:40.850069 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-ebcf21b8-34ca-4470-8c15-0a382de56493 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] [instance: 301ed3ad-5cb4-4ebf-ac32-519ab482cdea] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:08:40.856736 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ebcf21b8-34ca-4470-8c15-0a382de56493 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:08:40.859095 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ebcf21b8-34ca-4470-8c15-0a382de56493 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:08:40.859095 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ebcf21b8-34ca-4470-8c15-0a382de56493 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:08:40.859095 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ebcf21b8-34ca-4470-8c15-0a382de56493 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:08:40.988853 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-ebcf21b8-34ca-4470-8c15-0a382de56493 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf78e0fe86d4e078c0527248af45cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4239f4ae39bb49cf8063377a93875456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:08:40.996406 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-ebcf21b8-34ca-4470-8c15-0a382de56493 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] 10.222.0.58 "GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea" status: 200 len: 1261 microversion: 2.1 time: 0.150804 Jul 21 20:08:40.996960 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 220/420] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:08:40 2022] GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea => generated 1261 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:08:42.014219 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-4045ddbb-5270-4433-88a1-3c42a3c9a07c tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:08:42.014788 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-4045ddbb-5270-4433-88a1-3c42a3c9a07c tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] [instance: 301ed3ad-5cb4-4ebf-ac32-519ab482cdea] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:08:42.022176 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-4045ddbb-5270-4433-88a1-3c42a3c9a07c tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:08:42.022626 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-4045ddbb-5270-4433-88a1-3c42a3c9a07c tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:08:42.023420 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-4045ddbb-5270-4433-88a1-3c42a3c9a07c tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:08:42.023856 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-4045ddbb-5270-4433-88a1-3c42a3c9a07c tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:08:42.154292 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-4045ddbb-5270-4433-88a1-3c42a3c9a07c tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf78e0fe86d4e078c0527248af45cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4239f4ae39bb49cf8063377a93875456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:08:42.161615 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-4045ddbb-5270-4433-88a1-3c42a3c9a07c tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] 10.222.0.58 "GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea" status: 200 len: 1261 microversion: 2.1 time: 0.152054 Jul 21 20:08:42.162163 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 201/421] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:08:42 2022] GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea => generated 1261 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:08:43.178440 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-0912211e-79fc-4d0f-a067-4bc2d0164f73 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:08:43.179075 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-0912211e-79fc-4d0f-a067-4bc2d0164f73 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] [instance: 301ed3ad-5cb4-4ebf-ac32-519ab482cdea] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:08:43.185894 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0912211e-79fc-4d0f-a067-4bc2d0164f73 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:08:43.190668 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0912211e-79fc-4d0f-a067-4bc2d0164f73 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:08:43.190668 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0912211e-79fc-4d0f-a067-4bc2d0164f73 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:08:43.190668 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0912211e-79fc-4d0f-a067-4bc2d0164f73 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:08:43.318990 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-0912211e-79fc-4d0f-a067-4bc2d0164f73 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf78e0fe86d4e078c0527248af45cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4239f4ae39bb49cf8063377a93875456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:08:43.326983 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-0912211e-79fc-4d0f-a067-4bc2d0164f73 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] 10.222.0.58 "GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea" status: 200 len: 1261 microversion: 2.1 time: 0.152403 Jul 21 20:08:43.327567 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 221/422] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:08:43 2022] GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea => generated 1261 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:08:43.395088 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-0c9c2970-f163-4ad5-805e-40a8e3aa7b74 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "709026d0-85e3-4b94-9db6-a81ba9611c17"}} {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:08:43.396211 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-0c9c2970-f163-4ad5-805e-40a8e3aa7b74 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 8f00566b-862b-4171-9259-b12aaa7ea030] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:08:43.402617 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-0c9c2970-f163-4ad5-805e-40a8e3aa7b74 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:08:43.403098 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-0c9c2970-f163-4ad5-805e-40a8e3aa7b74 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:08:43.403856 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-0c9c2970-f163-4ad5-805e-40a8e3aa7b74 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:08:43.404287 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-0c9c2970-f163-4ad5-805e-40a8e3aa7b74 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:08:44.167356 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-0c9c2970-f163-4ad5-805e-40a8e3aa7b74 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "POST /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.776067 Jul 21 20:08:44.168064 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 202/423] 10.222.0.58 () {60 vars in 1322 bytes} [Thu Jul 21 20:08:43 2022] POST /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030/os-volume_attachments => generated 194 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:08:44.343801 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-e209971e-0e98-4af1-a5bd-a413ad68a0c2 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:08:44.344751 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-e209971e-0e98-4af1-a5bd-a413ad68a0c2 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] [instance: 301ed3ad-5cb4-4ebf-ac32-519ab482cdea] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:08:44.350775 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e209971e-0e98-4af1-a5bd-a413ad68a0c2 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:08:44.351253 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e209971e-0e98-4af1-a5bd-a413ad68a0c2 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:08:44.352007 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e209971e-0e98-4af1-a5bd-a413ad68a0c2 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:08:44.352433 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e209971e-0e98-4af1-a5bd-a413ad68a0c2 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:08:44.486550 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-e209971e-0e98-4af1-a5bd-a413ad68a0c2 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf78e0fe86d4e078c0527248af45cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4239f4ae39bb49cf8063377a93875456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:08:44.493936 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-e209971e-0e98-4af1-a5bd-a413ad68a0c2 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] 10.222.0.58 "GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea" status: 200 len: 1261 microversion: 2.1 time: 0.154017 Jul 21 20:08:44.494496 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 222/424] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:08:44 2022] GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:08:45.512448 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-b4a51b3e-d30e-458f-af20-e2f1ebbe0964 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:08:45.513726 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-b4a51b3e-d30e-458f-af20-e2f1ebbe0964 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] [instance: 301ed3ad-5cb4-4ebf-ac32-519ab482cdea] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:08:45.520177 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-b4a51b3e-d30e-458f-af20-e2f1ebbe0964 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:08:45.520627 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-b4a51b3e-d30e-458f-af20-e2f1ebbe0964 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:08:45.521392 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-b4a51b3e-d30e-458f-af20-e2f1ebbe0964 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:08:45.521828 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-b4a51b3e-d30e-458f-af20-e2f1ebbe0964 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:08:45.652810 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-b4a51b3e-d30e-458f-af20-e2f1ebbe0964 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf78e0fe86d4e078c0527248af45cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4239f4ae39bb49cf8063377a93875456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:08:45.660442 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-b4a51b3e-d30e-458f-af20-e2f1ebbe0964 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] 10.222.0.58 "GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea" status: 200 len: 1261 microversion: 2.1 time: 0.152682 Jul 21 20:08:45.661000 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 203/425] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:08:45 2022] GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea => generated 1261 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:08:46.331487 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-d0185dbe-0144-45a0-8e74-61e7a2b12c7c tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:08:46.331974 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-d0185dbe-0144-45a0-8e74-61e7a2b12c7c tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:08:46.337997 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d0185dbe-0144-45a0-8e74-61e7a2b12c7c tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:08:46.338431 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d0185dbe-0144-45a0-8e74-61e7a2b12c7c tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:08:46.339217 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d0185dbe-0144-45a0-8e74-61e7a2b12c7c tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:08:46.339661 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d0185dbe-0144-45a0-8e74-61e7a2b12c7c tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:08:46.364654 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-d0185dbe-0144-45a0-8e74-61e7a2b12c7c tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f/ips" status: 200 len: 151 microversion: 2.20 time: 0.037095 Jul 21 20:08:46.365216 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 223/426] 10.222.0.58 () {60 vars in 1288 bytes} [Thu Jul 21 20:08:46 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 20:08:46.676235 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-671ef533-7b67-422c-a3f3-5cdfc73a90fa tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:08:46.676949 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-671ef533-7b67-422c-a3f3-5cdfc73a90fa tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] [instance: 301ed3ad-5cb4-4ebf-ac32-519ab482cdea] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:08:46.683415 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-671ef533-7b67-422c-a3f3-5cdfc73a90fa tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:08:46.683867 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-671ef533-7b67-422c-a3f3-5cdfc73a90fa tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:08:46.684633 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-671ef533-7b67-422c-a3f3-5cdfc73a90fa tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:08:46.685653 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-671ef533-7b67-422c-a3f3-5cdfc73a90fa tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:08:46.818737 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-671ef533-7b67-422c-a3f3-5cdfc73a90fa tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf78e0fe86d4e078c0527248af45cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4239f4ae39bb49cf8063377a93875456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:08:46.826256 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-671ef533-7b67-422c-a3f3-5cdfc73a90fa tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] 10.222.0.58 "GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea" status: 200 len: 1261 microversion: 2.1 time: 0.153931 Jul 21 20:08:46.827959 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 204/427] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:08:46 2022] GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:08:47.494145 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [req-75fbfeec-ef69-4d8a-8519-1ab39d3cac3f req-417d5fe0-2236-4e68-a423-70a5ba3febed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "301ed3ad-5cb4-4ebf-ac32-519ab482cdea", "name": "network-vif-plugged", "status": "completed", "tag": "4300c7df-3693-4c3f-ae64-d9d267e9d57d"}]} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:08:47.502116 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-75fbfeec-ef69-4d8a-8519-1ab39d3cac3f req-417d5fe0-2236-4e68-a423-70a5ba3febed service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:08:47.502555 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-75fbfeec-ef69-4d8a-8519-1ab39d3cac3f req-417d5fe0-2236-4e68-a423-70a5ba3febed service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:08:47.513839 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.compute.server_external_events [req-75fbfeec-ef69-4d8a-8519-1ab39d3cac3f req-417d5fe0-2236-4e68-a423-70a5ba3febed service nova] Creating event network-vif-plugged:4300c7df-3693-4c3f-ae64-d9d267e9d57d for instance 301ed3ad-5cb4-4ebf-ac32-519ab482cdea on hv-cinder-85054 Jul 21 20:08:47.518662 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [req-75fbfeec-ef69-4d8a-8519-1ab39d3cac3f req-417d5fe0-2236-4e68-a423-70a5ba3febed service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028308 Jul 21 20:08:47.519404 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 224/428] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 20:08:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:08:47.752751 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-77916f96-ac41-42e8-bb05-e9bf3ffd3d07 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:08:47.753333 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-77916f96-ac41-42e8-bb05-e9bf3ffd3d07 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:08:47.759669 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-77916f96-ac41-42e8-bb05-e9bf3ffd3d07 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:08:47.760275 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-77916f96-ac41-42e8-bb05-e9bf3ffd3d07 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:08:47.761045 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-77916f96-ac41-42e8-bb05-e9bf3ffd3d07 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:08:47.761483 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-77916f96-ac41-42e8-bb05-e9bf3ffd3d07 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:08:47.784584 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-77916f96-ac41-42e8-bb05-e9bf3ffd3d07 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a/ips" status: 200 len: 146 microversion: 2.1 time: 0.035755 Jul 21 20:08:47.785065 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 205/429] 10.222.0.58 () {58 vars in 1247 bytes} [Thu Jul 21 20:08:47 2022] GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a/ips => generated 146 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:08:47.844987 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-6c8f2ad9-67af-43ee-af6d-0a6a88c3e50b tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:08:47.845747 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-6c8f2ad9-67af-43ee-af6d-0a6a88c3e50b tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] [instance: 301ed3ad-5cb4-4ebf-ac32-519ab482cdea] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:08:47.851940 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6c8f2ad9-67af-43ee-af6d-0a6a88c3e50b tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:08:47.852389 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6c8f2ad9-67af-43ee-af6d-0a6a88c3e50b tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:08:47.853148 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6c8f2ad9-67af-43ee-af6d-0a6a88c3e50b tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:08:47.853581 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6c8f2ad9-67af-43ee-af6d-0a6a88c3e50b tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:08:48.043611 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-6c8f2ad9-67af-43ee-af6d-0a6a88c3e50b tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf78e0fe86d4e078c0527248af45cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4239f4ae39bb49cf8063377a93875456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:08:48.052208 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-6c8f2ad9-67af-43ee-af6d-0a6a88c3e50b tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] 10.222.0.58 "GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea" status: 200 len: 1261 microversion: 2.1 time: 0.211677 Jul 21 20:08:48.052802 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 225/430] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:08:47 2022] GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea => generated 1261 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:08:49.072842 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-be451ce1-7b82-4480-a696-17b9b19eb709 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:08:49.073460 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-be451ce1-7b82-4480-a696-17b9b19eb709 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] [instance: 301ed3ad-5cb4-4ebf-ac32-519ab482cdea] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:08:49.080532 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-be451ce1-7b82-4480-a696-17b9b19eb709 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:08:49.081227 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-be451ce1-7b82-4480-a696-17b9b19eb709 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:08:49.082193 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-be451ce1-7b82-4480-a696-17b9b19eb709 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:08:49.082642 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-be451ce1-7b82-4480-a696-17b9b19eb709 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:08:49.212092 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-be451ce1-7b82-4480-a696-17b9b19eb709 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf78e0fe86d4e078c0527248af45cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4239f4ae39bb49cf8063377a93875456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:08:49.219699 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-be451ce1-7b82-4480-a696-17b9b19eb709 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] 10.222.0.58 "GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea" status: 200 len: 1261 microversion: 2.1 time: 0.150580 Jul 21 20:08:49.220257 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 206/431] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:08:49 2022] GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea => generated 1261 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:08:49.728988 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-8ce27450-898d-414b-9a51-5b791871d7b4 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:08:49.729698 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-8ce27450-898d-414b-9a51-5b791871d7b4 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:08:49.736272 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8ce27450-898d-414b-9a51-5b791871d7b4 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:08:49.741104 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8ce27450-898d-414b-9a51-5b791871d7b4 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:08:49.741104 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8ce27450-898d-414b-9a51-5b791871d7b4 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:08:49.741104 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8ce27450-898d-414b-9a51-5b791871d7b4 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:08:49.760819 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.objects.instance [None req-8ce27450-898d-414b-9a51-5b791871d7b4 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lazy-loading 'flavor' on Instance uuid b07e385b-3d8f-4370-a8fc-013a1c785c0f {{(pid=118345) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 20:08:50.235854 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-92746252-e24c-4f13-a1c9-fc2ef7964a76 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:08:50.236454 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-92746252-e24c-4f13-a1c9-fc2ef7964a76 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] [instance: 301ed3ad-5cb4-4ebf-ac32-519ab482cdea] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:08:50.242947 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-92746252-e24c-4f13-a1c9-fc2ef7964a76 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:08:50.243423 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-92746252-e24c-4f13-a1c9-fc2ef7964a76 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:08:50.246665 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-92746252-e24c-4f13-a1c9-fc2ef7964a76 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:08:50.246665 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-92746252-e24c-4f13-a1c9-fc2ef7964a76 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:08:50.378164 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-92746252-e24c-4f13-a1c9-fc2ef7964a76 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf78e0fe86d4e078c0527248af45cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4239f4ae39bb49cf8063377a93875456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:08:50.385888 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-92746252-e24c-4f13-a1c9-fc2ef7964a76 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] 10.222.0.58 "GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea" status: 200 len: 1261 microversion: 2.1 time: 0.153790 Jul 21 20:08:50.386465 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 207/432] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:08:50 2022] GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:08:50.408254 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-8ce27450-898d-414b-9a51-5b791871d7b4 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "POST /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f/action" status: 202 len: 0 microversion: 2.20 time: 0.684044 Jul 21 20:08:50.408860 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 226/433] 10.222.0.58 () {62 vars in 1318 bytes} [Thu Jul 21 20:08:49 2022] POST /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f/action => generated 0 bytes in 686 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 21 20:08:50.417171 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-8044c794-55a8-4738-8b7e-fb6918bbcd01 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:08:50.417813 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-8044c794-55a8-4738-8b7e-fb6918bbcd01 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:08:50.424311 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-8044c794-55a8-4738-8b7e-fb6918bbcd01 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:08:50.424761 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-8044c794-55a8-4738-8b7e-fb6918bbcd01 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:08:50.425529 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-8044c794-55a8-4738-8b7e-fb6918bbcd01 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:08:50.426014 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-8044c794-55a8-4738-8b7e-fb6918bbcd01 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:08:50.563969 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-8044c794-55a8-4738-8b7e-fb6918bbcd01 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:08:50.572028 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-8044c794-55a8-4738-8b7e-fb6918bbcd01 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:08:50.573542 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-8044c794-55a8-4738-8b7e-fb6918bbcd01 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:08:50.574712 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-8044c794-55a8-4738-8b7e-fb6918bbcd01 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1722 microversion: 2.20 time: 0.161454 Jul 21 20:08:50.575354 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 208/434] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:08:50 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:08:51.404744 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-b7e59dcf-9bc7-4224-ba99-731183ab5067 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:08:51.405469 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-b7e59dcf-9bc7-4224-ba99-731183ab5067 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] [instance: 301ed3ad-5cb4-4ebf-ac32-519ab482cdea] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:08:51.411909 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b7e59dcf-9bc7-4224-ba99-731183ab5067 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:08:51.412347 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b7e59dcf-9bc7-4224-ba99-731183ab5067 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:08:51.413303 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b7e59dcf-9bc7-4224-ba99-731183ab5067 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:08:51.413786 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b7e59dcf-9bc7-4224-ba99-731183ab5067 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:08:51.576708 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-b7e59dcf-9bc7-4224-ba99-731183ab5067 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf78e0fe86d4e078c0527248af45cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4239f4ae39bb49cf8063377a93875456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:08:51.584545 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-b7e59dcf-9bc7-4224-ba99-731183ab5067 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] 10.222.0.58 "GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea" status: 200 len: 1444 microversion: 2.1 time: 0.184869 Jul 21 20:08:51.585178 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 227/435] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:08:51 2022] GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea => generated 1444 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:08:51.593595 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-6f40c144-c6a5-406e-a962-182b77c88364 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:08:51.594469 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-6f40c144-c6a5-406e-a962-182b77c88364 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:08:51.600882 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-cf48f828-a704-48bd-808e-1c81844e8dc8 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:08:51.601065 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-6f40c144-c6a5-406e-a962-182b77c88364 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:08:51.601446 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-6f40c144-c6a5-406e-a962-182b77c88364 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:08:51.601819 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-cf48f828-a704-48bd-808e-1c81844e8dc8 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] [instance: 301ed3ad-5cb4-4ebf-ac32-519ab482cdea] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:08:51.602205 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-6f40c144-c6a5-406e-a962-182b77c88364 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:08:51.602720 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-6f40c144-c6a5-406e-a962-182b77c88364 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:08:51.608112 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-cf48f828-a704-48bd-808e-1c81844e8dc8 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:08:51.608559 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-cf48f828-a704-48bd-808e-1c81844e8dc8 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:08:51.609333 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-cf48f828-a704-48bd-808e-1c81844e8dc8 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:08:51.609787 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-cf48f828-a704-48bd-808e-1c81844e8dc8 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:08:51.736023 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-6f40c144-c6a5-406e-a962-182b77c88364 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:08:51.744176 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-6f40c144-c6a5-406e-a962-182b77c88364 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:08:51.745688 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-6f40c144-c6a5-406e-a962-182b77c88364 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:08:51.746862 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-6f40c144-c6a5-406e-a962-182b77c88364 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1722 microversion: 2.20 time: 0.157232 Jul 21 20:08:51.747983 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 209/436] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:08:51 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:08:51.749389 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-cf48f828-a704-48bd-808e-1c81844e8dc8 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf78e0fe86d4e078c0527248af45cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4239f4ae39bb49cf8063377a93875456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:08:51.752764 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-517ce664-b20d-409a-b307-73019bf20a6c tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f64e6d46-0c9b-4232-b699-521e8130af76"}} {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:08:51.753943 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-517ce664-b20d-409a-b307-73019bf20a6c tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:08:51.757197 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-cf48f828-a704-48bd-808e-1c81844e8dc8 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] 10.222.0.58 "GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea" status: 200 len: 1444 microversion: 2.1 time: 0.160178 Jul 21 20:08:51.759047 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 228/437] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:08:51 2022] GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea => generated 1444 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:08:51.759837 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-517ce664-b20d-409a-b307-73019bf20a6c tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:08:51.760294 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-517ce664-b20d-409a-b307-73019bf20a6c tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:08:51.761067 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-517ce664-b20d-409a-b307-73019bf20a6c tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:08:51.761497 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-517ce664-b20d-409a-b307-73019bf20a6c tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:08:51.779731 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG dbcounter [-] [118344] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:08:52.636935 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-517ce664-b20d-409a-b307-73019bf20a6c tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "POST /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.887563 Jul 21 20:08:52.638268 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 210/438] 10.222.0.58 () {60 vars in 1322 bytes} [Thu Jul 21 20:08:51 2022] POST /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a/os-volume_attachments => generated 194 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:08:52.731246 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-d29961ad-6f0b-41d3-9874-a6c5fb72d51f tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Action: 'create', calling method: .version_select at 0x7f351cea0ee0>, body: {"keypair": {"name": "tempest-keypair-26977631", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN3hr+bUCW1Zc+Sz844wvxYq8glWe5ZemUaNHChjiQARMEIqdmALJ8I+/LF2pZcHbZuEr5tznuQ/DwtjMtIkxzT8+KwsMfOU+G5HrLg/PaC2h1Qw0FfPmQt25PC0tHiBOA=="}} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:08:52.745223 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.quota [None req-d29961ad-6f0b-41d3-9874-a6c5fb72d51f tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Getting quotas for project e0075f5ba84547c782504d23f6029fd2. Resources: {'key_pairs'} {{(pid=118345) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 20:08:52.749513 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.quota [None req-d29961ad-6f0b-41d3-9874-a6c5fb72d51f tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Getting quotas for user d04a0e68aea7424181f6c2728cbf7e3f and project e0075f5ba84547c782504d23f6029fd2. Resources: {'key_pairs'} {{(pid=118345) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 20:08:52.767234 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-54ae6ead-549b-4eee-a8b9-0607b943c4d2 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:08:52.768215 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-54ae6ead-549b-4eee-a8b9-0607b943c4d2 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:08:52.774422 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-54ae6ead-549b-4eee-a8b9-0607b943c4d2 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:08:52.774868 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-54ae6ead-549b-4eee-a8b9-0607b943c4d2 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:08:52.775812 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-54ae6ead-549b-4eee-a8b9-0607b943c4d2 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:08:52.776252 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-54ae6ead-549b-4eee-a8b9-0607b943c4d2 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:08:52.848549 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-d29961ad-6f0b-41d3-9874-a6c5fb72d51f tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.121129 Jul 21 20:08:52.849254 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 229/439] 10.222.0.58 () {60 vars in 1158 bytes} [Thu Jul 21 20:08:52 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:08:53.066833 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-54ae6ead-549b-4eee-a8b9-0607b943c4d2 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:08:53.074870 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-54ae6ead-549b-4eee-a8b9-0607b943c4d2 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:08:53.076434 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-54ae6ead-549b-4eee-a8b9-0607b943c4d2 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:08:53.077592 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-54ae6ead-549b-4eee-a8b9-0607b943c4d2 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1722 microversion: 2.20 time: 0.315688 Jul 21 20:08:53.078158 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 211/440] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:08:52 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1722 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 20:08:54.096386 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-14d67271-8df2-4934-be20-a2129765d685 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:08:54.096992 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-14d67271-8df2-4934-be20-a2129765d685 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:08:54.103777 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-14d67271-8df2-4934-be20-a2129765d685 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:08:54.108591 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-14d67271-8df2-4934-be20-a2129765d685 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:08:54.108591 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-14d67271-8df2-4934-be20-a2129765d685 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:08:54.108591 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-14d67271-8df2-4934-be20-a2129765d685 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:08:54.262707 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [req-50b24479-26b9-41c1-9601-cfd2b810b68d req-e6a02e9a-c73a-4211-b5b1-e4c99ff4005a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "301ed3ad-5cb4-4ebf-ac32-519ab482cdea", "tag": "4300c7df-3693-4c3f-ae64-d9d267e9d57d"}]} {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:08:54.272769 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [req-50b24479-26b9-41c1-9601-cfd2b810b68d req-e6a02e9a-c73a-4211-b5b1-e4c99ff4005a service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:08:54.273289 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [req-50b24479-26b9-41c1-9601-cfd2b810b68d req-e6a02e9a-c73a-4211-b5b1-e4c99ff4005a service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:08:54.285495 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.compute.server_external_events [req-50b24479-26b9-41c1-9601-cfd2b810b68d req-e6a02e9a-c73a-4211-b5b1-e4c99ff4005a service nova] Creating event network-changed:4300c7df-3693-4c3f-ae64-d9d267e9d57d for instance 301ed3ad-5cb4-4ebf-ac32-519ab482cdea on hv-cinder-85054 Jul 21 20:08:54.291662 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [req-50b24479-26b9-41c1-9601-cfd2b810b68d req-e6a02e9a-c73a-4211-b5b1-e4c99ff4005a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033233 Jul 21 20:08:54.292886 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 212/441] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 20:08:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:08:54.323594 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-14d67271-8df2-4934-be20-a2129765d685 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:08:54.332226 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-14d67271-8df2-4934-be20-a2129765d685 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:08:54.333887 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-14d67271-8df2-4934-be20-a2129765d685 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:08:54.335801 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-14d67271-8df2-4934-be20-a2129765d685 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1722 microversion: 2.20 time: 0.243375 Jul 21 20:08:54.337658 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 230/442] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:08:54 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1722 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:08:55.357356 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-4f397295-33db-4140-a70d-bede2d76bd79 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:08:55.358379 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-4f397295-33db-4140-a70d-bede2d76bd79 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:08:55.364900 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-4f397295-33db-4140-a70d-bede2d76bd79 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:08:55.365349 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-4f397295-33db-4140-a70d-bede2d76bd79 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:08:55.366138 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-4f397295-33db-4140-a70d-bede2d76bd79 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:08:55.366567 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-4f397295-33db-4140-a70d-bede2d76bd79 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:08:55.502030 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-4f397295-33db-4140-a70d-bede2d76bd79 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:08:55.512216 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-4f397295-33db-4140-a70d-bede2d76bd79 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:08:55.514457 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-4f397295-33db-4140-a70d-bede2d76bd79 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:08:55.515672 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-4f397295-33db-4140-a70d-bede2d76bd79 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1722 microversion: 2.20 time: 0.163266 Jul 21 20:08:55.516228 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 213/443] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:08:55 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:08:55.784240 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-fe46cd15-ee27-409a-b4cb-49e932ccc50c tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1566124894", "imageRef": "357a1479-6cbd-4882-8d3f-d945fa40e6df", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8c189c91-a136-44cc-8a4c-a42d0a4465fc"}], "security_groups": [{"name": "tempest-securitygroup--1397260927"}], "key_name": "tempest-keypair-26977631", "user_data": "}} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:08:55.890952 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.network.neutron [None req-fe46cd15-ee27-409a-b4cb-49e932ccc50c tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] validate_networks() for [('8c189c91-a136-44cc-8a4c-a42d0a4465fc', None, None, None, None, None)] {{(pid=118345) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 20:08:56.490070 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-fe46cd15-ee27-409a-b4cb-49e932ccc50c tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Flavor limits 0:0:0 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 20:08:56.490490 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-fe46cd15-ee27-409a-b4cb-49e932ccc50c tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Image limits 0:0:0 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 20:08:56.490958 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-fe46cd15-ee27-409a-b4cb-49e932ccc50c tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Flavor pref 0:0:0 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 20:08:56.491459 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-fe46cd15-ee27-409a-b4cb-49e932ccc50c tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Image pref 0:0:0 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 20:08:56.491867 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-fe46cd15-ee27-409a-b4cb-49e932ccc50c tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 20:08:56.500473 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-fe46cd15-ee27-409a-b4cb-49e932ccc50c tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:08:56.500912 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-fe46cd15-ee27-409a-b4cb-49e932ccc50c tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:08:56.501710 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-fe46cd15-ee27-409a-b4cb-49e932ccc50c tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:08:56.502172 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-fe46cd15-ee27-409a-b4cb-49e932ccc50c tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:08:56.519574 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.quota [None req-fe46cd15-ee27-409a-b4cb-49e932ccc50c tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Getting quotas for project e0075f5ba84547c782504d23f6029fd2. Resources: {'instances', 'cores', 'ram'} {{(pid=118345) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 20:08:56.523598 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.quota [None req-fe46cd15-ee27-409a-b4cb-49e932ccc50c tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Getting quotas for user d04a0e68aea7424181f6c2728cbf7e3f and project e0075f5ba84547c782504d23f6029fd2. Resources: {'instances', 'cores', 'ram'} {{(pid=118345) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 20:08:56.534343 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-8594954c-47df-4395-b20b-0545481d42b9 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:08:56.534948 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-8594954c-47df-4395-b20b-0545481d42b9 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:08:56.535220 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-fe46cd15-ee27-409a-b4cb-49e932ccc50c tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Going to run 1 instances... {{(pid=118345) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 20:08:56.537562 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-fe46cd15-ee27-409a-b4cb-49e932ccc50c tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 1c38827c-8adc-4201-ae50-94e43ffbb63a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='357a1479-6cbd-4882-8d3f-d945fa40e6df',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118345) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 20:08:56.541839 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-8594954c-47df-4395-b20b-0545481d42b9 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:08:56.543395 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-8594954c-47df-4395-b20b-0545481d42b9 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:08:56.543395 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-8594954c-47df-4395-b20b-0545481d42b9 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:08:56.543646 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-8594954c-47df-4395-b20b-0545481d42b9 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:08:56.668634 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-fe46cd15-ee27-409a-b4cb-49e932ccc50c tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.888837 Jul 21 20:08:56.671553 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 231/444] 10.222.0.58 () {60 vars in 1146 bytes} [Thu Jul 21 20:08:55 2022] POST /compute/v2.1/servers => generated 402 bytes in 890 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 20:08:56.679292 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-9bbeda75-a076-423d-80f2-9a5ddb5ca263 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:08:56.679900 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-9bbeda75-a076-423d-80f2-9a5ddb5ca263 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 1c38827c-8adc-4201-ae50-94e43ffbb63a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:08:56.682572 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-8594954c-47df-4395-b20b-0545481d42b9 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:08:56.713923 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-8594954c-47df-4395-b20b-0545481d42b9 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:08:56.715489 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-8594954c-47df-4395-b20b-0545481d42b9 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:08:56.716709 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-8594954c-47df-4395-b20b-0545481d42b9 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1722 microversion: 2.20 time: 0.186238 Jul 21 20:08:56.717272 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 214/445] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:08:56 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 20:08:56.743754 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-9bbeda75-a076-423d-80f2-9a5ddb5ca263 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:08:56.752945 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-9bbeda75-a076-423d-80f2-9a5ddb5ca263 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/1c38827c-8adc-4201-ae50-94e43ffbb63a" status: 200 len: 1240 microversion: 2.1 time: 0.077346 Jul 21 20:08:56.753521 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 232/446] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:08:56 2022] GET /compute/v2.1/servers/1c38827c-8adc-4201-ae50-94e43ffbb63a => generated 1240 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:08:57.736111 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-c8d3ae70-0ca1-4847-adcd-ae859128a7a9 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:08:57.736730 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-c8d3ae70-0ca1-4847-adcd-ae859128a7a9 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:08:57.743259 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-c8d3ae70-0ca1-4847-adcd-ae859128a7a9 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:08:57.743708 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-c8d3ae70-0ca1-4847-adcd-ae859128a7a9 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:08:57.747149 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-c8d3ae70-0ca1-4847-adcd-ae859128a7a9 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:08:57.747149 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-c8d3ae70-0ca1-4847-adcd-ae859128a7a9 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:08:57.771128 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-f8e04ec1-4f16-46f7-8906-38204b7a388f tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:08:57.772017 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-f8e04ec1-4f16-46f7-8906-38204b7a388f tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 1c38827c-8adc-4201-ae50-94e43ffbb63a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:08:57.781482 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f8e04ec1-4f16-46f7-8906-38204b7a388f tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:08:57.781482 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f8e04ec1-4f16-46f7-8906-38204b7a388f tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:08:57.781482 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f8e04ec1-4f16-46f7-8906-38204b7a388f tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:08:57.781482 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f8e04ec1-4f16-46f7-8906-38204b7a388f tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:08:57.848485 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-f8e04ec1-4f16-46f7-8906-38204b7a388f tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:08:57.852035 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:08:57.857515 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-f8e04ec1-4f16-46f7-8906-38204b7a388f tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/1c38827c-8adc-4201-ae50-94e43ffbb63a" status: 200 len: 1244 microversion: 2.1 time: 0.089656 Jul 21 20:08:57.857995 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 233/447] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:08:57 2022] GET /compute/v2.1/servers/1c38827c-8adc-4201-ae50-94e43ffbb63a => generated 1244 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:08:57.886327 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-c8d3ae70-0ca1-4847-adcd-ae859128a7a9 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:08:57.894741 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-c8d3ae70-0ca1-4847-adcd-ae859128a7a9 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:08:57.896299 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-c8d3ae70-0ca1-4847-adcd-ae859128a7a9 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:08:57.897457 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-c8d3ae70-0ca1-4847-adcd-ae859128a7a9 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1722 microversion: 2.20 time: 0.165963 Jul 21 20:08:57.898010 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 215/448] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:08:57 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:08:58.875072 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-dbaa7330-adbf-479f-a154-d963dc525d36 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:08:58.881558 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-dbaa7330-adbf-479f-a154-d963dc525d36 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 1c38827c-8adc-4201-ae50-94e43ffbb63a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:08:58.882611 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-dbaa7330-adbf-479f-a154-d963dc525d36 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:08:58.883087 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-dbaa7330-adbf-479f-a154-d963dc525d36 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:08:58.883866 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-dbaa7330-adbf-479f-a154-d963dc525d36 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:08:58.884299 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-dbaa7330-adbf-479f-a154-d963dc525d36 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:08:58.916713 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-9fc8ebcb-0d2c-440a-b972-006ab31f1623 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:08:58.917303 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-9fc8ebcb-0d2c-440a-b972-006ab31f1623 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:08:58.919533 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG dbcounter [-] [118344] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=118344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:08:58.933219 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-9fc8ebcb-0d2c-440a-b972-006ab31f1623 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:08:58.939053 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-9fc8ebcb-0d2c-440a-b972-006ab31f1623 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:08:58.939053 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-9fc8ebcb-0d2c-440a-b972-006ab31f1623 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:08:58.939053 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-9fc8ebcb-0d2c-440a-b972-006ab31f1623 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:08:58.958050 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-dbaa7330-adbf-479f-a154-d963dc525d36 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:08:58.970861 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-dbaa7330-adbf-479f-a154-d963dc525d36 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/1c38827c-8adc-4201-ae50-94e43ffbb63a" status: 200 len: 1300 microversion: 2.1 time: 0.099620 Jul 21 20:08:58.977400 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 234/449] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:08:58 2022] GET /compute/v2.1/servers/1c38827c-8adc-4201-ae50-94e43ffbb63a => generated 1300 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:08:59.078214 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-9fc8ebcb-0d2c-440a-b972-006ab31f1623 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:08:59.086423 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-9fc8ebcb-0d2c-440a-b972-006ab31f1623 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:08:59.088047 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-9fc8ebcb-0d2c-440a-b972-006ab31f1623 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:08:59.089275 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-9fc8ebcb-0d2c-440a-b972-006ab31f1623 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1722 microversion: 2.20 time: 0.176997 Jul 21 20:08:59.089832 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 216/450] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:08:58 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 20:08:59.988278 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-46d7e9d0-bea8-407d-84bb-3d280d9b9d2a tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:08:59.988913 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-46d7e9d0-bea8-407d-84bb-3d280d9b9d2a tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 1c38827c-8adc-4201-ae50-94e43ffbb63a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:08:59.991122 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=4 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:08:59.996024 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-46d7e9d0-bea8-407d-84bb-3d280d9b9d2a tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:00.001887 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-46d7e9d0-bea8-407d-84bb-3d280d9b9d2a tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:00.001887 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-46d7e9d0-bea8-407d-84bb-3d280d9b9d2a tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:00.001887 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-46d7e9d0-bea8-407d-84bb-3d280d9b9d2a tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:00.108113 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-bd862c4d-3bd0-436f-975e-e2227f529cef tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:09:00.108727 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-bd862c4d-3bd0-436f-975e-e2227f529cef tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:09:00.115283 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-bd862c4d-3bd0-436f-975e-e2227f529cef tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:00.115732 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-bd862c4d-3bd0-436f-975e-e2227f529cef tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:00.116501 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-bd862c4d-3bd0-436f-975e-e2227f529cef tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:00.116934 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-bd862c4d-3bd0-436f-975e-e2227f529cef tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:00.129173 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-46d7e9d0-bea8-407d-84bb-3d280d9b9d2a tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:00.137514 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-46d7e9d0-bea8-407d-84bb-3d280d9b9d2a tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/1c38827c-8adc-4201-ae50-94e43ffbb63a" status: 200 len: 1366 microversion: 2.1 time: 0.153060 Jul 21 20:09:00.138087 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 235/451] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:08:59 2022] GET /compute/v2.1/servers/1c38827c-8adc-4201-ae50-94e43ffbb63a => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:09:00.248565 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-bd862c4d-3bd0-436f-975e-e2227f529cef tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:00.256665 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-bd862c4d-3bd0-436f-975e-e2227f529cef tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:00.258174 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-bd862c4d-3bd0-436f-975e-e2227f529cef tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:00.259386 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-bd862c4d-3bd0-436f-975e-e2227f529cef tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1722 microversion: 2.20 time: 0.156115 Jul 21 20:09:00.259949 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 217/452] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:09:00 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:09:01.081416 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [req-60cb3774-6679-4248-bbaa-286f44239719 req-41e74b0e-3506-48fd-84fd-636941216aa7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c38827c-8adc-4201-ae50-94e43ffbb63a", "tag": "20e5ee13-031b-47f4-b5fd-b3f29746df8a"}]} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:09:01.089510 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-60cb3774-6679-4248-bbaa-286f44239719 req-41e74b0e-3506-48fd-84fd-636941216aa7 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:01.090007 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-60cb3774-6679-4248-bbaa-286f44239719 req-41e74b0e-3506-48fd-84fd-636941216aa7 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:01.103661 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.compute.server_external_events [req-60cb3774-6679-4248-bbaa-286f44239719 req-41e74b0e-3506-48fd-84fd-636941216aa7 service nova] Creating event network-changed:20e5ee13-031b-47f4-b5fd-b3f29746df8a for instance 1c38827c-8adc-4201-ae50-94e43ffbb63a on hv-cinder-85054 Jul 21 20:09:01.109036 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [req-60cb3774-6679-4248-bbaa-286f44239719 req-41e74b0e-3506-48fd-84fd-636941216aa7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038836 Jul 21 20:09:01.109796 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 236/453] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 20:09:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:09:01.156930 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-4fe7a350-a01d-4cee-9d31-1bfe2c50bc51 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:09:01.157606 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-4fe7a350-a01d-4cee-9d31-1bfe2c50bc51 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 1c38827c-8adc-4201-ae50-94e43ffbb63a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:09:01.164506 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-4fe7a350-a01d-4cee-9d31-1bfe2c50bc51 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:01.164951 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-4fe7a350-a01d-4cee-9d31-1bfe2c50bc51 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:01.165720 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-4fe7a350-a01d-4cee-9d31-1bfe2c50bc51 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:01.166149 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-4fe7a350-a01d-4cee-9d31-1bfe2c50bc51 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:01.278808 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-a5bca8b1-42d8-443e-b40f-5ebc2b17f0fa tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:09:01.279558 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-a5bca8b1-42d8-443e-b40f-5ebc2b17f0fa tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:09:01.286389 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a5bca8b1-42d8-443e-b40f-5ebc2b17f0fa tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:01.286832 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a5bca8b1-42d8-443e-b40f-5ebc2b17f0fa tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:01.287830 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a5bca8b1-42d8-443e-b40f-5ebc2b17f0fa tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:01.288280 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a5bca8b1-42d8-443e-b40f-5ebc2b17f0fa tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:01.304455 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-4fe7a350-a01d-4cee-9d31-1bfe2c50bc51 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:01.313711 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-4fe7a350-a01d-4cee-9d31-1bfe2c50bc51 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/1c38827c-8adc-4201-ae50-94e43ffbb63a" status: 200 len: 1366 microversion: 2.1 time: 0.162516 Jul 21 20:09:01.314842 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 218/454] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:09:01 2022] GET /compute/v2.1/servers/1c38827c-8adc-4201-ae50-94e43ffbb63a => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:09:01.507765 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-a5bca8b1-42d8-443e-b40f-5ebc2b17f0fa tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:01.516681 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-a5bca8b1-42d8-443e-b40f-5ebc2b17f0fa tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:01.518188 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-a5bca8b1-42d8-443e-b40f-5ebc2b17f0fa tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:01.522961 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-a5bca8b1-42d8-443e-b40f-5ebc2b17f0fa tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1722 microversion: 2.20 time: 0.245381 Jul 21 20:09:01.522961 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 237/455] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:09:01 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1722 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 20:09:02.281787 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-d9df1395-a072-45d6-bd18-e285e2376050 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:09:02.288510 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-d9df1395-a072-45d6-bd18-e285e2376050 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:02.288961 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-d9df1395-a072-45d6-bd18-e285e2376050 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:02.332007 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-cfc8f060-043e-409b-8267-f04e7654f6df tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:09:02.332618 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-cfc8f060-043e-409b-8267-f04e7654f6df tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 1c38827c-8adc-4201-ae50-94e43ffbb63a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:09:02.338717 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-cfc8f060-043e-409b-8267-f04e7654f6df tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:02.339213 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-cfc8f060-043e-409b-8267-f04e7654f6df tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:02.339973 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-cfc8f060-043e-409b-8267-f04e7654f6df tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:02.340410 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-cfc8f060-043e-409b-8267-f04e7654f6df tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:02.352294 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-d9df1395-a072-45d6-bd18-e285e2376050 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a] Going to try to stop instance {{(pid=118344) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 21 20:09:02.472973 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-cfc8f060-043e-409b-8267-f04e7654f6df tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:02.480515 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-cfc8f060-043e-409b-8267-f04e7654f6df tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/1c38827c-8adc-4201-ae50-94e43ffbb63a" status: 200 len: 1366 microversion: 2.1 time: 0.152457 Jul 21 20:09:02.481083 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 238/456] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:09:02 2022] GET /compute/v2.1/servers/1c38827c-8adc-4201-ae50-94e43ffbb63a => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:09:02.532942 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-d9df1395-a072-45d6-bd18-e285e2376050 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "POST /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a/action" status: 202 len: 0 microversion: 2.1 time: 0.255320 Jul 21 20:09:02.533575 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 219/457] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Jul 21 20:09:02 2022] POST /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a/action => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 20:09:02.538191 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-4ce09404-026a-452f-96d3-a9b82000013e tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:09:02.539037 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-4ce09404-026a-452f-96d3-a9b82000013e tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:09:02.544267 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-e5209517-b414-4667-a50e-349cdca8eeef tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:09:02.544962 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-e5209517-b414-4667-a50e-349cdca8eeef tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:09:02.545177 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4ce09404-026a-452f-96d3-a9b82000013e tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:02.545624 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4ce09404-026a-452f-96d3-a9b82000013e tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:02.546388 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4ce09404-026a-452f-96d3-a9b82000013e tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:02.546827 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4ce09404-026a-452f-96d3-a9b82000013e tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:02.551049 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-e5209517-b414-4667-a50e-349cdca8eeef tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:02.551518 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-e5209517-b414-4667-a50e-349cdca8eeef tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:02.552294 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-e5209517-b414-4667-a50e-349cdca8eeef tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:02.552727 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-e5209517-b414-4667-a50e-349cdca8eeef tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:02.675831 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-4ce09404-026a-452f-96d3-a9b82000013e tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:02.683649 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-4ce09404-026a-452f-96d3-a9b82000013e tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:02.685744 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-4ce09404-026a-452f-96d3-a9b82000013e tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:02.686906 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-4ce09404-026a-452f-96d3-a9b82000013e tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1722 microversion: 2.20 time: 0.153182 Jul 21 20:09:02.687500 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 239/458] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:09:02 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 20:09:02.699869 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-e5209517-b414-4667-a50e-349cdca8eeef tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:02.708595 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-e5209517-b414-4667-a50e-349cdca8eeef tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a" status: 200 len: 1723 microversion: 2.1 time: 0.168286 Jul 21 20:09:02.709091 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 220/459] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:09:02 2022] GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:09:03.497205 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-7b40dfd4-9b66-4b1e-b8ab-2ac8bae7b707 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:09:03.497813 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-7b40dfd4-9b66-4b1e-b8ab-2ac8bae7b707 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 1c38827c-8adc-4201-ae50-94e43ffbb63a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:09:03.503971 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-7b40dfd4-9b66-4b1e-b8ab-2ac8bae7b707 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:03.504410 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-7b40dfd4-9b66-4b1e-b8ab-2ac8bae7b707 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:03.505163 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-7b40dfd4-9b66-4b1e-b8ab-2ac8bae7b707 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:03.505593 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-7b40dfd4-9b66-4b1e-b8ab-2ac8bae7b707 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:03.636654 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-7b40dfd4-9b66-4b1e-b8ab-2ac8bae7b707 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:03.644144 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-7b40dfd4-9b66-4b1e-b8ab-2ac8bae7b707 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/1c38827c-8adc-4201-ae50-94e43ffbb63a" status: 200 len: 1366 microversion: 2.1 time: 0.150816 Jul 21 20:09:03.644716 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 240/460] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:09:03 2022] GET /compute/v2.1/servers/1c38827c-8adc-4201-ae50-94e43ffbb63a => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:09:03.704986 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-95bf4814-3113-4434-aa49-050a9c8978cd tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:09:03.705619 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-95bf4814-3113-4434-aa49-050a9c8978cd tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:09:03.711991 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-95bf4814-3113-4434-aa49-050a9c8978cd tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:03.712437 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-95bf4814-3113-4434-aa49-050a9c8978cd tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:03.713186 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-95bf4814-3113-4434-aa49-050a9c8978cd tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:03.713617 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-95bf4814-3113-4434-aa49-050a9c8978cd tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:03.725586 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-5d2f1190-8af3-4f28-9d92-eb778abf5b55 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:09:03.726234 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-5d2f1190-8af3-4f28-9d92-eb778abf5b55 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:09:03.732757 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5d2f1190-8af3-4f28-9d92-eb778abf5b55 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:03.733201 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5d2f1190-8af3-4f28-9d92-eb778abf5b55 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:03.733955 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5d2f1190-8af3-4f28-9d92-eb778abf5b55 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:03.734380 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5d2f1190-8af3-4f28-9d92-eb778abf5b55 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:03.845389 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-95bf4814-3113-4434-aa49-050a9c8978cd tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:03.853292 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-95bf4814-3113-4434-aa49-050a9c8978cd tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:03.854799 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-95bf4814-3113-4434-aa49-050a9c8978cd tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:03.855980 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-95bf4814-3113-4434-aa49-050a9c8978cd tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1722 microversion: 2.20 time: 0.154843 Jul 21 20:09:03.856595 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 221/461] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:09:03 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:09:03.862600 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-5d2f1190-8af3-4f28-9d92-eb778abf5b55 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:03.870566 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-5d2f1190-8af3-4f28-9d92-eb778abf5b55 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a" status: 200 len: 1723 microversion: 2.1 time: 0.148724 Jul 21 20:09:03.871137 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 241/462] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:09:03 2022] GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:09:04.661465 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-9e44ad29-ef68-40d3-9455-92c9f4124fb0 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:09:04.662078 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-9e44ad29-ef68-40d3-9455-92c9f4124fb0 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 1c38827c-8adc-4201-ae50-94e43ffbb63a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:09:04.667999 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-9e44ad29-ef68-40d3-9455-92c9f4124fb0 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:04.668441 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-9e44ad29-ef68-40d3-9455-92c9f4124fb0 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:04.669227 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-9e44ad29-ef68-40d3-9455-92c9f4124fb0 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:04.669656 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-9e44ad29-ef68-40d3-9455-92c9f4124fb0 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:04.799889 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-9e44ad29-ef68-40d3-9455-92c9f4124fb0 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:04.807289 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-9e44ad29-ef68-40d3-9455-92c9f4124fb0 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/1c38827c-8adc-4201-ae50-94e43ffbb63a" status: 200 len: 1366 microversion: 2.1 time: 0.149648 Jul 21 20:09:04.807858 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 222/463] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:09:04 2022] GET /compute/v2.1/servers/1c38827c-8adc-4201-ae50-94e43ffbb63a => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:09:04.874223 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-3fdb4536-6fe2-40dc-ac20-4400a263b368 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:09:04.874833 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-3fdb4536-6fe2-40dc-ac20-4400a263b368 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:09:04.880934 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3fdb4536-6fe2-40dc-ac20-4400a263b368 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:04.881377 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3fdb4536-6fe2-40dc-ac20-4400a263b368 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:04.882567 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3fdb4536-6fe2-40dc-ac20-4400a263b368 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:04.882757 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3fdb4536-6fe2-40dc-ac20-4400a263b368 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:04.887511 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-6291fead-53f8-4a41-ac97-7977a9ffe69c tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:09:04.888125 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-6291fead-53f8-4a41-ac97-7977a9ffe69c tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:09:04.894033 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-6291fead-53f8-4a41-ac97-7977a9ffe69c tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:04.894477 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-6291fead-53f8-4a41-ac97-7977a9ffe69c tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:04.895329 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-6291fead-53f8-4a41-ac97-7977a9ffe69c tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:04.895703 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-6291fead-53f8-4a41-ac97-7977a9ffe69c tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:05.017060 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-3fdb4536-6fe2-40dc-ac20-4400a263b368 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:05.024799 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-6291fead-53f8-4a41-ac97-7977a9ffe69c tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:05.024936 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-3fdb4536-6fe2-40dc-ac20-4400a263b368 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:05.026431 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-3fdb4536-6fe2-40dc-ac20-4400a263b368 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:05.027614 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-3fdb4536-6fe2-40dc-ac20-4400a263b368 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1722 microversion: 2.20 time: 0.157949 Jul 21 20:09:05.028723 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 242/464] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:09:04 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:09:05.033373 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-6291fead-53f8-4a41-ac97-7977a9ffe69c tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a" status: 200 len: 1723 microversion: 2.1 time: 0.149714 Jul 21 20:09:05.033986 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 223/465] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:09:04 2022] GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:09:05.824743 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-82461440-38ae-4ddd-970a-acac453a8575 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:09:05.826074 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-82461440-38ae-4ddd-970a-acac453a8575 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 1c38827c-8adc-4201-ae50-94e43ffbb63a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:09:05.832742 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-82461440-38ae-4ddd-970a-acac453a8575 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:05.833198 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-82461440-38ae-4ddd-970a-acac453a8575 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:05.833968 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-82461440-38ae-4ddd-970a-acac453a8575 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:05.834405 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-82461440-38ae-4ddd-970a-acac453a8575 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:05.965089 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-82461440-38ae-4ddd-970a-acac453a8575 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:05.972781 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-82461440-38ae-4ddd-970a-acac453a8575 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/1c38827c-8adc-4201-ae50-94e43ffbb63a" status: 200 len: 1366 microversion: 2.1 time: 0.151983 Jul 21 20:09:05.973337 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 243/466] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:09:05 2022] GET /compute/v2.1/servers/1c38827c-8adc-4201-ae50-94e43ffbb63a => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:09:06.046266 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-c4416801-2ff5-4d92-9ae4-9786a1623229 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:09:06.046952 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-c4416801-2ff5-4d92-9ae4-9786a1623229 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:09:06.050643 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-cab62dd0-81a3-4d04-b4f8-a313c8690695 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:09:06.051267 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-cab62dd0-81a3-4d04-b4f8-a313c8690695 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:09:06.053638 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-c4416801-2ff5-4d92-9ae4-9786a1623229 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:06.054086 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-c4416801-2ff5-4d92-9ae4-9786a1623229 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:06.054937 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-c4416801-2ff5-4d92-9ae4-9786a1623229 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:06.055404 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-c4416801-2ff5-4d92-9ae4-9786a1623229 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:06.057394 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-cab62dd0-81a3-4d04-b4f8-a313c8690695 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:06.057846 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-cab62dd0-81a3-4d04-b4f8-a313c8690695 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:06.058645 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-cab62dd0-81a3-4d04-b4f8-a313c8690695 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:06.059162 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-cab62dd0-81a3-4d04-b4f8-a313c8690695 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:06.187565 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-cab62dd0-81a3-4d04-b4f8-a313c8690695 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:06.190752 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-c4416801-2ff5-4d92-9ae4-9786a1623229 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:06.195612 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-cab62dd0-81a3-4d04-b4f8-a313c8690695 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a" status: 200 len: 1723 microversion: 2.1 time: 0.148595 Jul 21 20:09:06.196180 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 244/467] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:09:06 2022] GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:09:06.198837 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-c4416801-2ff5-4d92-9ae4-9786a1623229 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:06.200428 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-c4416801-2ff5-4d92-9ae4-9786a1623229 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:06.201586 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-c4416801-2ff5-4d92-9ae4-9786a1623229 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1743 microversion: 2.20 time: 0.159982 Jul 21 20:09:06.202138 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 224/468] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:09:06 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1743 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:09:06.990943 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-41f8fde0-d3ed-4c7d-99dd-21fdceef4268 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:09:06.991572 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-41f8fde0-d3ed-4c7d-99dd-21fdceef4268 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 1c38827c-8adc-4201-ae50-94e43ffbb63a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:09:06.993514 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell0:SELECT=2 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:09:06.994184 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell0:SELECT=12 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:09:06.999590 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-41f8fde0-d3ed-4c7d-99dd-21fdceef4268 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:07.000029 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-41f8fde0-d3ed-4c7d-99dd-21fdceef4268 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:07.000830 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-41f8fde0-d3ed-4c7d-99dd-21fdceef4268 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:07.001240 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-41f8fde0-d3ed-4c7d-99dd-21fdceef4268 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:07.131544 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-41f8fde0-d3ed-4c7d-99dd-21fdceef4268 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:07.138799 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-41f8fde0-d3ed-4c7d-99dd-21fdceef4268 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/1c38827c-8adc-4201-ae50-94e43ffbb63a" status: 200 len: 1366 microversion: 2.1 time: 0.153461 Jul 21 20:09:07.139380 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 245/469] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:09:06 2022] GET /compute/v2.1/servers/1c38827c-8adc-4201-ae50-94e43ffbb63a => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:09:07.212718 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-275103ea-69e7-4376-bfd8-a3e603a26ecb tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:09:07.213331 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-275103ea-69e7-4376-bfd8-a3e603a26ecb tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:09:07.220714 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-275103ea-69e7-4376-bfd8-a3e603a26ecb tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:07.221163 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-275103ea-69e7-4376-bfd8-a3e603a26ecb tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:07.221931 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-275103ea-69e7-4376-bfd8-a3e603a26ecb tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:07.222097 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-2d30275b-9d8c-4009-b5a5-ef8d264a0645 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:09:07.222432 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-275103ea-69e7-4376-bfd8-a3e603a26ecb tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:07.222757 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-2d30275b-9d8c-4009-b5a5-ef8d264a0645 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:09:07.228635 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2d30275b-9d8c-4009-b5a5-ef8d264a0645 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:07.229067 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2d30275b-9d8c-4009-b5a5-ef8d264a0645 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:07.229821 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2d30275b-9d8c-4009-b5a5-ef8d264a0645 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:07.230243 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2d30275b-9d8c-4009-b5a5-ef8d264a0645 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:07.241505 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG dbcounter [-] [118344] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:09:07.354171 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-275103ea-69e7-4376-bfd8-a3e603a26ecb tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:07.361313 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-2d30275b-9d8c-4009-b5a5-ef8d264a0645 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:07.362626 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-275103ea-69e7-4376-bfd8-a3e603a26ecb tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a" status: 200 len: 1723 microversion: 2.1 time: 0.153804 Jul 21 20:09:07.363225 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 225/470] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:09:07 2022] GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:09:07.369467 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-2d30275b-9d8c-4009-b5a5-ef8d264a0645 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:07.371044 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-2d30275b-9d8c-4009-b5a5-ef8d264a0645 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:07.372193 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-2d30275b-9d8c-4009-b5a5-ef8d264a0645 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1743 microversion: 2.20 time: 0.154146 Jul 21 20:09:07.372735 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 246/471] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:09:07 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1743 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 20:09:07.675854 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [req-3494dc24-3237-44d0-98dc-dc84ae5e33b1 req-51d9d4d2-d840-4eae-a553-a17b006024df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b07e385b-3d8f-4370-a8fc-013a1c785c0f", "name": "network-vif-plugged", "status": "completed", "tag": "b6f7db3f-a2e0-4b71-a01c-2b805c7bf070"}]} {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:09:07.684871 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [req-3494dc24-3237-44d0-98dc-dc84ae5e33b1 req-51d9d4d2-d840-4eae-a553-a17b006024df service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:07.685704 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [req-3494dc24-3237-44d0-98dc-dc84ae5e33b1 req-51d9d4d2-d840-4eae-a553-a17b006024df service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:07.697096 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.compute.server_external_events [req-3494dc24-3237-44d0-98dc-dc84ae5e33b1 req-51d9d4d2-d840-4eae-a553-a17b006024df service nova] Creating event network-vif-plugged:b6f7db3f-a2e0-4b71-a01c-2b805c7bf070 for instance b07e385b-3d8f-4370-a8fc-013a1c785c0f on hv-cinder-85054 Jul 21 20:09:07.702996 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [req-3494dc24-3237-44d0-98dc-dc84ae5e33b1 req-51d9d4d2-d840-4eae-a553-a17b006024df service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031514 Jul 21 20:09:07.703683 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 226/472] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 20:09:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 20:09:08.155538 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-1a915cf3-ba46-44ba-8882-ca339c258e80 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:09:08.156059 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-1a915cf3-ba46-44ba-8882-ca339c258e80 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 1c38827c-8adc-4201-ae50-94e43ffbb63a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:09:08.162028 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1a915cf3-ba46-44ba-8882-ca339c258e80 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:08.162472 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1a915cf3-ba46-44ba-8882-ca339c258e80 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:08.163267 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1a915cf3-ba46-44ba-8882-ca339c258e80 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:08.163698 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1a915cf3-ba46-44ba-8882-ca339c258e80 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:08.292547 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-1a915cf3-ba46-44ba-8882-ca339c258e80 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:08.300375 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-1a915cf3-ba46-44ba-8882-ca339c258e80 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/1c38827c-8adc-4201-ae50-94e43ffbb63a" status: 200 len: 1366 microversion: 2.1 time: 0.148782 Jul 21 20:09:08.300934 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 247/473] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:09:08 2022] GET /compute/v2.1/servers/1c38827c-8adc-4201-ae50-94e43ffbb63a => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:09:08.380791 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-86395330-7038-4dfe-b828-f92a99fad54c tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:09:08.381528 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-86395330-7038-4dfe-b828-f92a99fad54c tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:09:08.387836 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-86395330-7038-4dfe-b828-f92a99fad54c tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:08.388288 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-86395330-7038-4dfe-b828-f92a99fad54c tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:08.389064 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-86395330-7038-4dfe-b828-f92a99fad54c tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:08.389505 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-86395330-7038-4dfe-b828-f92a99fad54c tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:08.389679 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-49bfb3dd-4481-4784-b439-8f9f3dbba479 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:09:08.390261 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-49bfb3dd-4481-4784-b439-8f9f3dbba479 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:09:08.396376 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-49bfb3dd-4481-4784-b439-8f9f3dbba479 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:08.396828 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-49bfb3dd-4481-4784-b439-8f9f3dbba479 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:08.397595 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-49bfb3dd-4481-4784-b439-8f9f3dbba479 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:08.398703 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-49bfb3dd-4481-4784-b439-8f9f3dbba479 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:08.537078 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-86395330-7038-4dfe-b828-f92a99fad54c tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:08.540350 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-49bfb3dd-4481-4784-b439-8f9f3dbba479 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:08.545589 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-86395330-7038-4dfe-b828-f92a99fad54c tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a" status: 200 len: 1723 microversion: 2.1 time: 0.169599 Jul 21 20:09:08.546372 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 227/474] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:09:08 2022] GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:09:08.548931 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-49bfb3dd-4481-4784-b439-8f9f3dbba479 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:08.550445 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-49bfb3dd-4481-4784-b439-8f9f3dbba479 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:08.551617 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-49bfb3dd-4481-4784-b439-8f9f3dbba479 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1743 microversion: 2.20 time: 0.165925 Jul 21 20:09:08.552170 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 248/475] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:09:08 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1743 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 20:09:09.317676 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-4f923afc-d617-4fd4-b738-a87401f08100 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:09:09.318313 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-4f923afc-d617-4fd4-b738-a87401f08100 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 1c38827c-8adc-4201-ae50-94e43ffbb63a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:09:09.324279 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-4f923afc-d617-4fd4-b738-a87401f08100 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:09.325229 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-4f923afc-d617-4fd4-b738-a87401f08100 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:09.325975 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-4f923afc-d617-4fd4-b738-a87401f08100 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:09.326401 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-4f923afc-d617-4fd4-b738-a87401f08100 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:09.456951 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-4f923afc-d617-4fd4-b738-a87401f08100 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:09.464328 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-4f923afc-d617-4fd4-b738-a87401f08100 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/1c38827c-8adc-4201-ae50-94e43ffbb63a" status: 200 len: 1366 microversion: 2.1 time: 0.150563 Jul 21 20:09:09.464917 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 228/476] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:09:09 2022] GET /compute/v2.1/servers/1c38827c-8adc-4201-ae50-94e43ffbb63a => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:09:09.566067 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-3a7c6a2a-6289-4640-804f-ad89852ef997 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:09:09.566681 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-3a7c6a2a-6289-4640-804f-ad89852ef997 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:09:09.570023 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-3eeafc41-a218-48cd-b76c-8389feb6e664 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:09:09.570670 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-3eeafc41-a218-48cd-b76c-8389feb6e664 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:09:09.576199 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3a7c6a2a-6289-4640-804f-ad89852ef997 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:09.576673 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3a7c6a2a-6289-4640-804f-ad89852ef997 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:09.577347 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-3eeafc41-a218-48cd-b76c-8389feb6e664 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:09.577460 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3a7c6a2a-6289-4640-804f-ad89852ef997 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:09.577790 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-3eeafc41-a218-48cd-b76c-8389feb6e664 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:09.577886 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3a7c6a2a-6289-4640-804f-ad89852ef997 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:09.578550 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-3eeafc41-a218-48cd-b76c-8389feb6e664 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:09.578982 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-3eeafc41-a218-48cd-b76c-8389feb6e664 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:09.707337 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-3eeafc41-a218-48cd-b76c-8389feb6e664 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:09.707771 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-3a7c6a2a-6289-4640-804f-ad89852ef997 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:09.715941 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-3eeafc41-a218-48cd-b76c-8389feb6e664 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:09.717470 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-3eeafc41-a218-48cd-b76c-8389feb6e664 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:09.718174 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-3a7c6a2a-6289-4640-804f-ad89852ef997 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a" status: 200 len: 1723 microversion: 2.1 time: 0.159163 Jul 21 20:09:09.718642 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-3eeafc41-a218-48cd-b76c-8389feb6e664 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1743 microversion: 2.20 time: 0.152454 Jul 21 20:09:09.720328 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 249/477] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:09:09 2022] GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:09:09.720461 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 229/478] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:09:09 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1743 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:09:10.482208 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-852dc0e8-63b3-48c0-bd1a-b8c6b3c15e47 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:09:10.482814 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-852dc0e8-63b3-48c0-bd1a-b8c6b3c15e47 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 1c38827c-8adc-4201-ae50-94e43ffbb63a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:09:10.488786 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-852dc0e8-63b3-48c0-bd1a-b8c6b3c15e47 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:10.489227 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-852dc0e8-63b3-48c0-bd1a-b8c6b3c15e47 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:10.490027 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-852dc0e8-63b3-48c0-bd1a-b8c6b3c15e47 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:10.490458 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-852dc0e8-63b3-48c0-bd1a-b8c6b3c15e47 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:10.626675 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-852dc0e8-63b3-48c0-bd1a-b8c6b3c15e47 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:10.634146 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-852dc0e8-63b3-48c0-bd1a-b8c6b3c15e47 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/1c38827c-8adc-4201-ae50-94e43ffbb63a" status: 200 len: 1366 microversion: 2.1 time: 0.156461 Jul 21 20:09:10.634719 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 250/479] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:09:10 2022] GET /compute/v2.1/servers/1c38827c-8adc-4201-ae50-94e43ffbb63a => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:09:10.655294 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [req-130ab007-e7e8-46b4-a604-ca5eb701950f req-30f25454-a191-42d4-b6a8-4fe2db054665 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c38827c-8adc-4201-ae50-94e43ffbb63a", "name": "network-vif-plugged", "status": "completed", "tag": "20e5ee13-031b-47f4-b5fd-b3f29746df8a"}]} {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:09:10.664166 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [req-130ab007-e7e8-46b4-a604-ca5eb701950f req-30f25454-a191-42d4-b6a8-4fe2db054665 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:10.664614 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [req-130ab007-e7e8-46b4-a604-ca5eb701950f req-30f25454-a191-42d4-b6a8-4fe2db054665 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:10.675529 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.compute.server_external_events [req-130ab007-e7e8-46b4-a604-ca5eb701950f req-30f25454-a191-42d4-b6a8-4fe2db054665 service nova] Creating event network-vif-plugged:20e5ee13-031b-47f4-b5fd-b3f29746df8a for instance 1c38827c-8adc-4201-ae50-94e43ffbb63a on hv-cinder-85054 Jul 21 20:09:10.680600 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [req-130ab007-e7e8-46b4-a604-ca5eb701950f req-30f25454-a191-42d4-b6a8-4fe2db054665 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029588 Jul 21 20:09:10.681285 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 230/480] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 20:09:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:09:10.737640 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-f9591145-25af-43c0-9ecc-b745ad5f9695 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:09:10.738253 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-f9591145-25af-43c0-9ecc-b745ad5f9695 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:09:10.741916 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-c4508e40-e81e-4fbe-99e9-68b8b626acaa tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:09:10.742616 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-c4508e40-e81e-4fbe-99e9-68b8b626acaa tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:09:10.744426 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f9591145-25af-43c0-9ecc-b745ad5f9695 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:10.744873 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f9591145-25af-43c0-9ecc-b745ad5f9695 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:10.745648 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f9591145-25af-43c0-9ecc-b745ad5f9695 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:10.746079 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f9591145-25af-43c0-9ecc-b745ad5f9695 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:10.748723 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-c4508e40-e81e-4fbe-99e9-68b8b626acaa tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:10.749165 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-c4508e40-e81e-4fbe-99e9-68b8b626acaa tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:10.749926 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-c4508e40-e81e-4fbe-99e9-68b8b626acaa tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:10.750078 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell1:SELECT=100 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:09:10.751321 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-c4508e40-e81e-4fbe-99e9-68b8b626acaa tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:10.891496 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-f9591145-25af-43c0-9ecc-b745ad5f9695 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:10.897011 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-c4508e40-e81e-4fbe-99e9-68b8b626acaa tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:10.899701 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-f9591145-25af-43c0-9ecc-b745ad5f9695 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a" status: 200 len: 1723 microversion: 2.1 time: 0.166007 Jul 21 20:09:10.900278 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 251/481] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:09:10 2022] GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:09:10.906127 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-c4508e40-e81e-4fbe-99e9-68b8b626acaa tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:10.907680 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-c4508e40-e81e-4fbe-99e9-68b8b626acaa tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:10.908829 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-c4508e40-e81e-4fbe-99e9-68b8b626acaa tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1743 microversion: 2.20 time: 0.171068 Jul 21 20:09:10.909402 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 231/482] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:09:10 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1743 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:09:11.651498 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-b04455c4-cbdb-4cd3-bb42-7f2b6dc7c90b tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:09:11.652137 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-b04455c4-cbdb-4cd3-bb42-7f2b6dc7c90b tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 1c38827c-8adc-4201-ae50-94e43ffbb63a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:09:11.658732 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b04455c4-cbdb-4cd3-bb42-7f2b6dc7c90b tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:11.659222 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b04455c4-cbdb-4cd3-bb42-7f2b6dc7c90b tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:11.659983 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b04455c4-cbdb-4cd3-bb42-7f2b6dc7c90b tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:11.660416 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b04455c4-cbdb-4cd3-bb42-7f2b6dc7c90b tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:11.786208 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-b04455c4-cbdb-4cd3-bb42-7f2b6dc7c90b tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:11.793575 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-b04455c4-cbdb-4cd3-bb42-7f2b6dc7c90b tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/1c38827c-8adc-4201-ae50-94e43ffbb63a" status: 200 len: 1366 microversion: 2.1 time: 0.145930 Jul 21 20:09:11.794144 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 252/483] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:09:11 2022] GET /compute/v2.1/servers/1c38827c-8adc-4201-ae50-94e43ffbb63a => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:09:11.917967 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-f0650c65-e806-4b51-b64b-8f396587abcd tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:09:11.918474 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-f0650c65-e806-4b51-b64b-8f396587abcd tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:09:11.925538 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f0650c65-e806-4b51-b64b-8f396587abcd tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:11.925974 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f0650c65-e806-4b51-b64b-8f396587abcd tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:11.926606 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-e7078efa-ce37-412c-9303-35f81686dbe9 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:09:11.926731 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f0650c65-e806-4b51-b64b-8f396587abcd tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:11.927195 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f0650c65-e806-4b51-b64b-8f396587abcd tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:11.927313 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-e7078efa-ce37-412c-9303-35f81686dbe9 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:09:11.933083 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e7078efa-ce37-412c-9303-35f81686dbe9 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:11.933521 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e7078efa-ce37-412c-9303-35f81686dbe9 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:11.934272 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e7078efa-ce37-412c-9303-35f81686dbe9 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:11.934700 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e7078efa-ce37-412c-9303-35f81686dbe9 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:12.056192 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-f0650c65-e806-4b51-b64b-8f396587abcd tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:12.064140 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-f0650c65-e806-4b51-b64b-8f396587abcd tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a" status: 200 len: 1723 microversion: 2.1 time: 0.150772 Jul 21 20:09:12.064711 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 232/484] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:09:11 2022] GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:09:12.065346 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-e7078efa-ce37-412c-9303-35f81686dbe9 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:12.073213 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-e7078efa-ce37-412c-9303-35f81686dbe9 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:12.074714 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-e7078efa-ce37-412c-9303-35f81686dbe9 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:12.076381 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-e7078efa-ce37-412c-9303-35f81686dbe9 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1743 microversion: 2.20 time: 0.153594 Jul 21 20:09:12.076921 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 253/485] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:09:11 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1743 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 20:09:12.811793 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-5a616d16-5f9c-408d-984c-9995c44e907b tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:09:12.812396 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-5a616d16-5f9c-408d-984c-9995c44e907b tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 1c38827c-8adc-4201-ae50-94e43ffbb63a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:09:12.818565 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-5a616d16-5f9c-408d-984c-9995c44e907b tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:12.819039 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-5a616d16-5f9c-408d-984c-9995c44e907b tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:12.819817 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-5a616d16-5f9c-408d-984c-9995c44e907b tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:12.820252 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-5a616d16-5f9c-408d-984c-9995c44e907b tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:12.948503 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-5a616d16-5f9c-408d-984c-9995c44e907b tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:12.955950 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-5a616d16-5f9c-408d-984c-9995c44e907b tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/1c38827c-8adc-4201-ae50-94e43ffbb63a" status: 200 len: 1366 microversion: 2.1 time: 0.148629 Jul 21 20:09:12.956514 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 233/486] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:09:12 2022] GET /compute/v2.1/servers/1c38827c-8adc-4201-ae50-94e43ffbb63a => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:09:13.081357 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-8e8d9ce8-e5b9-40fa-a0bf-b26bcb5f9744 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:09:13.081946 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-8e8d9ce8-e5b9-40fa-a0bf-b26bcb5f9744 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:09:13.087958 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8e8d9ce8-e5b9-40fa-a0bf-b26bcb5f9744 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:13.088393 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8e8d9ce8-e5b9-40fa-a0bf-b26bcb5f9744 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:13.089141 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8e8d9ce8-e5b9-40fa-a0bf-b26bcb5f9744 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:13.089568 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8e8d9ce8-e5b9-40fa-a0bf-b26bcb5f9744 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:13.094081 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-c4eeea7a-f548-4151-bb4c-779116b334f1 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:09:13.094946 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-c4eeea7a-f548-4151-bb4c-779116b334f1 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:09:13.100937 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-c4eeea7a-f548-4151-bb4c-779116b334f1 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:13.101381 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-c4eeea7a-f548-4151-bb4c-779116b334f1 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:13.102149 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-c4eeea7a-f548-4151-bb4c-779116b334f1 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:13.102582 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-c4eeea7a-f548-4151-bb4c-779116b334f1 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:13.220424 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-8e8d9ce8-e5b9-40fa-a0bf-b26bcb5f9744 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:13.228311 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-8e8d9ce8-e5b9-40fa-a0bf-b26bcb5f9744 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a" status: 200 len: 1723 microversion: 2.1 time: 0.150803 Jul 21 20:09:13.228874 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 254/487] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:09:13 2022] GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:09:13.235785 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-c4eeea7a-f548-4151-bb4c-779116b334f1 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:13.243790 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-c4eeea7a-f548-4151-bb4c-779116b334f1 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:13.245285 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-c4eeea7a-f548-4151-bb4c-779116b334f1 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:13.246459 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-c4eeea7a-f548-4151-bb4c-779116b334f1 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1738 microversion: 2.20 time: 0.156197 Jul 21 20:09:13.247094 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 234/488] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:09:13 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1738 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 20:09:13.972864 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-e502f4fb-c6c0-4430-a03d-bff4a3d87869 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:09:13.973461 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-e502f4fb-c6c0-4430-a03d-bff4a3d87869 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 1c38827c-8adc-4201-ae50-94e43ffbb63a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:09:13.979343 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e502f4fb-c6c0-4430-a03d-bff4a3d87869 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:13.979784 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e502f4fb-c6c0-4430-a03d-bff4a3d87869 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:13.980535 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e502f4fb-c6c0-4430-a03d-bff4a3d87869 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:13.980961 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e502f4fb-c6c0-4430-a03d-bff4a3d87869 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:14.128883 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-e502f4fb-c6c0-4430-a03d-bff4a3d87869 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:14.138503 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-e502f4fb-c6c0-4430-a03d-bff4a3d87869 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/1c38827c-8adc-4201-ae50-94e43ffbb63a" status: 200 len: 1556 microversion: 2.1 time: 0.169003 Jul 21 20:09:14.139103 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 255/489] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:09:13 2022] GET /compute/v2.1/servers/1c38827c-8adc-4201-ae50-94e43ffbb63a => generated 1556 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:09:14.155981 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-486f4224-eb3c-4d13-a9fa-4d02d61e1346 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:09:14.156780 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-486f4224-eb3c-4d13-a9fa-4d02d61e1346 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 1c38827c-8adc-4201-ae50-94e43ffbb63a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:09:14.163654 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-486f4224-eb3c-4d13-a9fa-4d02d61e1346 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:14.165572 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-486f4224-eb3c-4d13-a9fa-4d02d61e1346 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:14.166735 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-486f4224-eb3c-4d13-a9fa-4d02d61e1346 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:14.167358 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-486f4224-eb3c-4d13-a9fa-4d02d61e1346 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:14.246901 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-147f3ec1-0c36-4102-959b-462bb268801d tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:09:14.248220 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-147f3ec1-0c36-4102-959b-462bb268801d tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:09:14.248424 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-486f4224-eb3c-4d13-a9fa-4d02d61e1346 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/1c38827c-8adc-4201-ae50-94e43ffbb63a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096705 Jul 21 20:09:14.249017 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 235/490] 10.222.0.58 () {58 vars in 1274 bytes} [Thu Jul 21 20:09:14 2022] GET /compute/v2.1/servers/1c38827c-8adc-4201-ae50-94e43ffbb63a/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:09:14.256974 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-147f3ec1-0c36-4102-959b-462bb268801d tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:14.257429 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-147f3ec1-0c36-4102-959b-462bb268801d tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:14.258435 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-147f3ec1-0c36-4102-959b-462bb268801d tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:14.258869 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-147f3ec1-0c36-4102-959b-462bb268801d tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:14.267258 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-1ac17691-9d91-4874-b2e6-55f8d156a6fc tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:09:14.267861 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-1ac17691-9d91-4874-b2e6-55f8d156a6fc tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:09:14.274865 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-1ac17691-9d91-4874-b2e6-55f8d156a6fc tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:14.275337 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-1ac17691-9d91-4874-b2e6-55f8d156a6fc tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:14.278523 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-1ac17691-9d91-4874-b2e6-55f8d156a6fc tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:14.279170 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-1ac17691-9d91-4874-b2e6-55f8d156a6fc tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:14.447130 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-1ac17691-9d91-4874-b2e6-55f8d156a6fc tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:14.456314 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-1ac17691-9d91-4874-b2e6-55f8d156a6fc tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:14.458072 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-1ac17691-9d91-4874-b2e6-55f8d156a6fc tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:14.459485 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-1ac17691-9d91-4874-b2e6-55f8d156a6fc tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1738 microversion: 2.20 time: 0.197156 Jul 21 20:09:14.460663 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 236/491] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:09:14 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1738 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:09:14.624558 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-147f3ec1-0c36-4102-959b-462bb268801d tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:14.641222 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-147f3ec1-0c36-4102-959b-462bb268801d tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a" status: 200 len: 1723 microversion: 2.1 time: 0.398613 Jul 21 20:09:14.655100 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 256/492] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:09:14 2022] GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a => generated 1723 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:09:15.411645 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [req-c4d1afc2-6d63-4dec-a8a0-6148c7bdc141 req-fc5d0e56-f303-4676-be03-853639792162 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c38827c-8adc-4201-ae50-94e43ffbb63a", "tag": "20e5ee13-031b-47f4-b5fd-b3f29746df8a"}]} {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:09:15.423684 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [req-c4d1afc2-6d63-4dec-a8a0-6148c7bdc141 req-fc5d0e56-f303-4676-be03-853639792162 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:15.424426 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [req-c4d1afc2-6d63-4dec-a8a0-6148c7bdc141 req-fc5d0e56-f303-4676-be03-853639792162 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:15.442097 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.compute.server_external_events [req-c4d1afc2-6d63-4dec-a8a0-6148c7bdc141 req-fc5d0e56-f303-4676-be03-853639792162 service nova] Creating event network-changed:20e5ee13-031b-47f4-b5fd-b3f29746df8a for instance 1c38827c-8adc-4201-ae50-94e43ffbb63a on hv-cinder-85054 Jul 21 20:09:15.447337 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [req-c4d1afc2-6d63-4dec-a8a0-6148c7bdc141 req-fc5d0e56-f303-4676-be03-853639792162 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040275 Jul 21 20:09:15.448743 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 237/493] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 20:09:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 20:09:15.503233 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-dc4c63b2-9067-42ee-be7c-f001ceceaea8 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:09:15.503774 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-dc4c63b2-9067-42ee-be7c-f001ceceaea8 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:09:15.517994 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-dc4c63b2-9067-42ee-be7c-f001ceceaea8 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:15.518456 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-dc4c63b2-9067-42ee-be7c-f001ceceaea8 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:15.520511 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-dc4c63b2-9067-42ee-be7c-f001ceceaea8 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:15.521143 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-dc4c63b2-9067-42ee-be7c-f001ceceaea8 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:15.661745 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-f86914e0-b2a4-48a8-9423-7e7b270406cc tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:09:15.662709 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-f86914e0-b2a4-48a8-9423-7e7b270406cc tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:09:15.672013 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f86914e0-b2a4-48a8-9423-7e7b270406cc tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:15.673415 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f86914e0-b2a4-48a8-9423-7e7b270406cc tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:15.674421 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f86914e0-b2a4-48a8-9423-7e7b270406cc tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:15.675249 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f86914e0-b2a4-48a8-9423-7e7b270406cc tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:15.839184 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-f86914e0-b2a4-48a8-9423-7e7b270406cc tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:15.850960 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-f86914e0-b2a4-48a8-9423-7e7b270406cc tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a" status: 200 len: 1723 microversion: 2.1 time: 0.193348 Jul 21 20:09:15.851913 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 238/494] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:09:15 2022] GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a => generated 1723 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:09:15.964089 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-dc4c63b2-9067-42ee-be7c-f001ceceaea8 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:15.973626 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-dc4c63b2-9067-42ee-be7c-f001ceceaea8 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:15.975156 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-dc4c63b2-9067-42ee-be7c-f001ceceaea8 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:15.976519 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-dc4c63b2-9067-42ee-be7c-f001ceceaea8 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1738 microversion: 2.20 time: 0.497784 Jul 21 20:09:15.977298 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 257/495] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:09:15 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1738 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:09:16.871352 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-ac24c0b6-b7f1-420e-a1d2-363fb7c384ad tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:09:16.872807 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-ac24c0b6-b7f1-420e-a1d2-363fb7c384ad tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:09:16.880654 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-ac24c0b6-b7f1-420e-a1d2-363fb7c384ad tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:16.881412 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-ac24c0b6-b7f1-420e-a1d2-363fb7c384ad tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:16.882514 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-ac24c0b6-b7f1-420e-a1d2-363fb7c384ad tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:16.883237 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-ac24c0b6-b7f1-420e-a1d2-363fb7c384ad tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:16.994898 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-8d2b18ec-8b5f-414e-96c9-4ac8ec9997da tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:09:16.996368 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-8d2b18ec-8b5f-414e-96c9-4ac8ec9997da tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:09:17.007003 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8d2b18ec-8b5f-414e-96c9-4ac8ec9997da tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:17.014291 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8d2b18ec-8b5f-414e-96c9-4ac8ec9997da tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:17.015879 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8d2b18ec-8b5f-414e-96c9-4ac8ec9997da tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:17.017970 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8d2b18ec-8b5f-414e-96c9-4ac8ec9997da tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:17.052705 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-ac24c0b6-b7f1-420e-a1d2-363fb7c384ad tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:17.076198 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-ac24c0b6-b7f1-420e-a1d2-363fb7c384ad tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a" status: 200 len: 1700 microversion: 2.1 time: 0.198560 Jul 21 20:09:17.076198 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 239/496] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:09:16 2022] GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a => generated 1700 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:09:17.088003 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-f837dfc1-6f4e-46a1-9963-428ae2748478 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:09:17.100042 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f837dfc1-6f4e-46a1-9963-428ae2748478 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:17.100042 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f837dfc1-6f4e-46a1-9963-428ae2748478 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:17.124938 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-f837dfc1-6f4e-46a1-9963-428ae2748478 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a] Going to try to start instance {{(pid=118344) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 21 20:09:17.206706 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-8d2b18ec-8b5f-414e-96c9-4ac8ec9997da tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:17.211919 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-8d2b18ec-8b5f-414e-96c9-4ac8ec9997da tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:17.213423 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-8d2b18ec-8b5f-414e-96c9-4ac8ec9997da tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:17.214566 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-8d2b18ec-8b5f-414e-96c9-4ac8ec9997da tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1738 microversion: 2.20 time: 0.223829 Jul 21 20:09:17.215141 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 258/497] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:09:16 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1738 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:09:17.824006 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-f837dfc1-6f4e-46a1-9963-428ae2748478 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "POST /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a/action" status: 202 len: 0 microversion: 2.1 time: 0.739700 Jul 21 20:09:17.824907 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 240/498] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Jul 21 20:09:17 2022] POST /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a/action => generated 0 bytes in 742 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 21 20:09:17.833403 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-1f6ab8d8-838f-4360-85dd-b28e471716d8 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:09:17.844302 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-1f6ab8d8-838f-4360-85dd-b28e471716d8 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:09:17.844302 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1f6ab8d8-838f-4360-85dd-b28e471716d8 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:17.844302 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1f6ab8d8-838f-4360-85dd-b28e471716d8 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:17.844302 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1f6ab8d8-838f-4360-85dd-b28e471716d8 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:17.844949 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1f6ab8d8-838f-4360-85dd-b28e471716d8 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:18.009506 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-1f6ab8d8-838f-4360-85dd-b28e471716d8 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:18.018875 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-1f6ab8d8-838f-4360-85dd-b28e471716d8 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a" status: 200 len: 1709 microversion: 2.1 time: 0.189475 Jul 21 20:09:18.019634 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 259/499] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:09:17 2022] GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a => generated 1709 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:09:18.234383 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-b0bd1ef3-572c-4807-a1b2-057ee70bb816 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:09:18.239217 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-b0bd1ef3-572c-4807-a1b2-057ee70bb816 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:09:18.241835 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-b0bd1ef3-572c-4807-a1b2-057ee70bb816 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:18.242658 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-b0bd1ef3-572c-4807-a1b2-057ee70bb816 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:18.243986 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-b0bd1ef3-572c-4807-a1b2-057ee70bb816 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:18.244606 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-b0bd1ef3-572c-4807-a1b2-057ee70bb816 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:18.392008 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-b0bd1ef3-572c-4807-a1b2-057ee70bb816 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:18.402105 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-b0bd1ef3-572c-4807-a1b2-057ee70bb816 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:18.404659 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-b0bd1ef3-572c-4807-a1b2-057ee70bb816 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:18.406099 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-b0bd1ef3-572c-4807-a1b2-057ee70bb816 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1738 microversion: 2.20 time: 0.177831 Jul 21 20:09:18.407570 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 241/500] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:09:18 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1738 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:09:19.039587 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-47a5363e-b9d2-470a-a62f-65fc551c3789 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:09:19.040835 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-47a5363e-b9d2-470a-a62f-65fc551c3789 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:09:19.051891 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-47a5363e-b9d2-470a-a62f-65fc551c3789 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:19.052346 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-47a5363e-b9d2-470a-a62f-65fc551c3789 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:19.053351 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-47a5363e-b9d2-470a-a62f-65fc551c3789 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:19.053789 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-47a5363e-b9d2-470a-a62f-65fc551c3789 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:19.211153 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-47a5363e-b9d2-470a-a62f-65fc551c3789 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:19.221717 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-47a5363e-b9d2-470a-a62f-65fc551c3789 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a" status: 200 len: 1709 microversion: 2.1 time: 0.186334 Jul 21 20:09:19.222949 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 260/501] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:09:19 2022] GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a => generated 1709 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:09:19.425654 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-b3d9afff-c789-4378-8ccc-4c5ddeae46e7 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:09:19.427206 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-b3d9afff-c789-4378-8ccc-4c5ddeae46e7 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:09:19.434098 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-b3d9afff-c789-4378-8ccc-4c5ddeae46e7 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:19.434826 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-b3d9afff-c789-4378-8ccc-4c5ddeae46e7 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:19.435700 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-b3d9afff-c789-4378-8ccc-4c5ddeae46e7 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:19.436354 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-b3d9afff-c789-4378-8ccc-4c5ddeae46e7 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:19.573444 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-b3d9afff-c789-4378-8ccc-4c5ddeae46e7 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:19.582873 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-b3d9afff-c789-4378-8ccc-4c5ddeae46e7 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:19.584459 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-b3d9afff-c789-4378-8ccc-4c5ddeae46e7 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:19.585614 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-b3d9afff-c789-4378-8ccc-4c5ddeae46e7 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1738 microversion: 2.20 time: 0.163966 Jul 21 20:09:19.586174 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 242/502] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:09:19 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1738 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:09:20.240695 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-f326048d-9642-479f-bec3-f11c4ec9a955 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:09:20.241319 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-f326048d-9642-479f-bec3-f11c4ec9a955 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:09:20.247749 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f326048d-9642-479f-bec3-f11c4ec9a955 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:20.248193 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f326048d-9642-479f-bec3-f11c4ec9a955 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:20.248959 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f326048d-9642-479f-bec3-f11c4ec9a955 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:20.249393 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f326048d-9642-479f-bec3-f11c4ec9a955 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:20.391008 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-f326048d-9642-479f-bec3-f11c4ec9a955 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:20.399554 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-f326048d-9642-479f-bec3-f11c4ec9a955 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a" status: 200 len: 1713 microversion: 2.1 time: 0.162730 Jul 21 20:09:20.400256 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 261/503] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:09:20 2022] GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a => generated 1713 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:09:20.618904 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-15512ec8-43c1-4682-86e4-5851ca71e50d tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:09:20.619638 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-15512ec8-43c1-4682-86e4-5851ca71e50d tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:09:20.626476 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-15512ec8-43c1-4682-86e4-5851ca71e50d tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:20.627239 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-15512ec8-43c1-4682-86e4-5851ca71e50d tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:20.628027 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-15512ec8-43c1-4682-86e4-5851ca71e50d tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:20.628462 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-15512ec8-43c1-4682-86e4-5851ca71e50d tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:20.649685 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG dbcounter [-] [118344] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:09:20.774019 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-15512ec8-43c1-4682-86e4-5851ca71e50d tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:20.782195 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-15512ec8-43c1-4682-86e4-5851ca71e50d tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:20.783742 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-15512ec8-43c1-4682-86e4-5851ca71e50d tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:20.784905 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-15512ec8-43c1-4682-86e4-5851ca71e50d tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1738 microversion: 2.20 time: 0.183195 Jul 21 20:09:20.785466 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 243/504] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:09:20 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1738 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:09:21.803502 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-a5cf4690-e1ec-4be5-99ea-bb19a301c2a5 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:09:21.804105 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-a5cf4690-e1ec-4be5-99ea-bb19a301c2a5 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:09:21.810443 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a5cf4690-e1ec-4be5-99ea-bb19a301c2a5 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:21.811044 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a5cf4690-e1ec-4be5-99ea-bb19a301c2a5 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:21.811825 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a5cf4690-e1ec-4be5-99ea-bb19a301c2a5 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:21.812259 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a5cf4690-e1ec-4be5-99ea-bb19a301c2a5 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:21.952750 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-a5cf4690-e1ec-4be5-99ea-bb19a301c2a5 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:21.960810 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-a5cf4690-e1ec-4be5-99ea-bb19a301c2a5 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:21.962368 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-a5cf4690-e1ec-4be5-99ea-bb19a301c2a5 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:21.963571 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-a5cf4690-e1ec-4be5-99ea-bb19a301c2a5 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1738 microversion: 2.20 time: 0.164292 Jul 21 20:09:21.964303 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 262/505] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:09:21 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1738 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:09:22.984507 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-4ce961d0-64da-495f-afe1-d1aff2e89e94 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:09:22.985128 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-4ce961d0-64da-495f-afe1-d1aff2e89e94 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:09:22.992644 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-4ce961d0-64da-495f-afe1-d1aff2e89e94 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:22.993151 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-4ce961d0-64da-495f-afe1-d1aff2e89e94 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:22.994012 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-4ce961d0-64da-495f-afe1-d1aff2e89e94 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:22.994501 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-4ce961d0-64da-495f-afe1-d1aff2e89e94 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:23.135722 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-4ce961d0-64da-495f-afe1-d1aff2e89e94 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:23.144996 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-4ce961d0-64da-495f-afe1-d1aff2e89e94 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:23.146426 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-4ce961d0-64da-495f-afe1-d1aff2e89e94 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:23.148016 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-4ce961d0-64da-495f-afe1-d1aff2e89e94 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1738 microversion: 2.20 time: 0.168895 Jul 21 20:09:23.148903 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 244/506] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:09:22 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1738 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:09:24.168462 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-541c3982-e32a-43d2-8c57-9a6361a0de3e tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:09:24.170661 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-541c3982-e32a-43d2-8c57-9a6361a0de3e tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:09:24.178617 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-541c3982-e32a-43d2-8c57-9a6361a0de3e tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:24.179096 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-541c3982-e32a-43d2-8c57-9a6361a0de3e tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:24.179878 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-541c3982-e32a-43d2-8c57-9a6361a0de3e tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:24.180314 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-541c3982-e32a-43d2-8c57-9a6361a0de3e tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:24.371943 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-541c3982-e32a-43d2-8c57-9a6361a0de3e tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:24.384386 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-541c3982-e32a-43d2-8c57-9a6361a0de3e tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:24.386556 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-541c3982-e32a-43d2-8c57-9a6361a0de3e tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:24.387877 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-541c3982-e32a-43d2-8c57-9a6361a0de3e tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1738 microversion: 2.20 time: 0.223918 Jul 21 20:09:24.388519 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 263/507] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:09:24 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1738 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:09:25.406539 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-19a488f1-e533-40a3-b24f-26d4979e10cc tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:09:25.407154 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-19a488f1-e533-40a3-b24f-26d4979e10cc tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:09:25.413646 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-19a488f1-e533-40a3-b24f-26d4979e10cc tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:25.414094 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-19a488f1-e533-40a3-b24f-26d4979e10cc tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:25.415008 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-19a488f1-e533-40a3-b24f-26d4979e10cc tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:25.415487 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-19a488f1-e533-40a3-b24f-26d4979e10cc tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:25.551945 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-19a488f1-e533-40a3-b24f-26d4979e10cc tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:25.560747 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-19a488f1-e533-40a3-b24f-26d4979e10cc tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:25.562603 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-19a488f1-e533-40a3-b24f-26d4979e10cc tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:25.563801 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-19a488f1-e533-40a3-b24f-26d4979e10cc tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1738 microversion: 2.20 time: 0.161329 Jul 21 20:09:25.565353 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 245/508] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:09:25 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1738 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:09:26.582816 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-a345e296-d678-41ca-be6c-ccd51c366fcf tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:09:26.585323 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-a345e296-d678-41ca-be6c-ccd51c366fcf tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:09:26.589652 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a345e296-d678-41ca-be6c-ccd51c366fcf tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:26.590090 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a345e296-d678-41ca-be6c-ccd51c366fcf tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:26.591527 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a345e296-d678-41ca-be6c-ccd51c366fcf tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:26.591954 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a345e296-d678-41ca-be6c-ccd51c366fcf tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:26.727419 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-a345e296-d678-41ca-be6c-ccd51c366fcf tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:26.735425 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-a345e296-d678-41ca-be6c-ccd51c366fcf tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:26.736910 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-a345e296-d678-41ca-be6c-ccd51c366fcf tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:26.738047 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-a345e296-d678-41ca-be6c-ccd51c366fcf tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1738 microversion: 2.20 time: 0.159539 Jul 21 20:09:26.738603 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 264/509] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:09:26 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1738 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:09:27.756897 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-48d0b463-4a76-4179-818c-d202ebfcb3ad tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:09:27.757505 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-48d0b463-4a76-4179-818c-d202ebfcb3ad tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:09:27.764755 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-48d0b463-4a76-4179-818c-d202ebfcb3ad tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:27.765206 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-48d0b463-4a76-4179-818c-d202ebfcb3ad tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:27.765998 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-48d0b463-4a76-4179-818c-d202ebfcb3ad tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:27.766483 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-48d0b463-4a76-4179-818c-d202ebfcb3ad tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:27.898373 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-48d0b463-4a76-4179-818c-d202ebfcb3ad tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:27.906985 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-48d0b463-4a76-4179-818c-d202ebfcb3ad tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:27.908528 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-48d0b463-4a76-4179-818c-d202ebfcb3ad tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:27.909695 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-48d0b463-4a76-4179-818c-d202ebfcb3ad tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1720 microversion: 2.20 time: 0.156860 Jul 21 20:09:27.910259 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 246/510] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:09:27 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:09:28.928051 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-46d37452-b2b5-46b3-bba1-08e659423848 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:09:28.928661 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-46d37452-b2b5-46b3-bba1-08e659423848 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:09:28.934888 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-46d37452-b2b5-46b3-bba1-08e659423848 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:28.935360 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-46d37452-b2b5-46b3-bba1-08e659423848 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:28.936115 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-46d37452-b2b5-46b3-bba1-08e659423848 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:28.936546 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-46d37452-b2b5-46b3-bba1-08e659423848 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:29.062511 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-46d37452-b2b5-46b3-bba1-08e659423848 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:29.070364 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-46d37452-b2b5-46b3-bba1-08e659423848 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:29.071903 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-46d37452-b2b5-46b3-bba1-08e659423848 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:29.073051 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-46d37452-b2b5-46b3-bba1-08e659423848 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1720 microversion: 2.20 time: 0.148880 Jul 21 20:09:29.073611 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 265/511] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:09:28 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1720 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:09:30.091500 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-bb44037f-355e-48e9-b798-1200d85f6550 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:09:30.092028 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-bb44037f-355e-48e9-b798-1200d85f6550 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:09:30.098802 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-bb44037f-355e-48e9-b798-1200d85f6550 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:30.099283 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-bb44037f-355e-48e9-b798-1200d85f6550 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:30.100045 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-bb44037f-355e-48e9-b798-1200d85f6550 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:30.100479 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-bb44037f-355e-48e9-b798-1200d85f6550 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:30.227257 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-bb44037f-355e-48e9-b798-1200d85f6550 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:30.235145 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-bb44037f-355e-48e9-b798-1200d85f6550 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:30.236657 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-bb44037f-355e-48e9-b798-1200d85f6550 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:30.237803 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-bb44037f-355e-48e9-b798-1200d85f6550 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1720 microversion: 2.20 time: 0.151037 Jul 21 20:09:30.238359 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 247/512] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:09:30 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:09:30.733781 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [req-788fb0f9-6e88-4c88-abec-e71aa3210813 req-19ca1a92-0cb5-4741-8a8e-6c9d99ab4615 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b07e385b-3d8f-4370-a8fc-013a1c785c0f", "name": "network-vif-unplugged", "status": "completed", "tag": "b6f7db3f-a2e0-4b71-a01c-2b805c7bf070"}]} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:09:30.737322 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_api:SELECT=62 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:09:30.742465 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-788fb0f9-6e88-4c88-abec-e71aa3210813 req-19ca1a92-0cb5-4741-8a8e-6c9d99ab4615 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:30.742895 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-788fb0f9-6e88-4c88-abec-e71aa3210813 req-19ca1a92-0cb5-4741-8a8e-6c9d99ab4615 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:30.754284 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.compute.server_external_events [req-788fb0f9-6e88-4c88-abec-e71aa3210813 req-19ca1a92-0cb5-4741-8a8e-6c9d99ab4615 service nova] Creating event network-vif-unplugged:b6f7db3f-a2e0-4b71-a01c-2b805c7bf070 for instance b07e385b-3d8f-4370-a8fc-013a1c785c0f on hv-cinder-85054 Jul 21 20:09:30.759482 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [req-788fb0f9-6e88-4c88-abec-e71aa3210813 req-19ca1a92-0cb5-4741-8a8e-6c9d99ab4615 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029392 Jul 21 20:09:30.760060 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 266/513] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 20:09:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:09:31.256367 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-6e6231fc-8b7f-49f0-94f3-9391ddc4dfef tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:09:31.257033 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-6e6231fc-8b7f-49f0-94f3-9391ddc4dfef tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:09:31.258974 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG dbcounter [-] [118344] Writing DB stats nova_api:SELECT=64 {{(pid=118344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:09:31.263692 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-6e6231fc-8b7f-49f0-94f3-9391ddc4dfef tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:31.264182 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-6e6231fc-8b7f-49f0-94f3-9391ddc4dfef tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:31.269002 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-6e6231fc-8b7f-49f0-94f3-9391ddc4dfef tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:31.269002 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-6e6231fc-8b7f-49f0-94f3-9391ddc4dfef tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:31.396922 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-6e6231fc-8b7f-49f0-94f3-9391ddc4dfef tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:31.405305 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-6e6231fc-8b7f-49f0-94f3-9391ddc4dfef tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:31.406842 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-6e6231fc-8b7f-49f0-94f3-9391ddc4dfef tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:31.408028 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-6e6231fc-8b7f-49f0-94f3-9391ddc4dfef tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1663 microversion: 2.20 time: 0.156031 Jul 21 20:09:31.408584 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 248/514] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:09:31 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1663 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 20:09:31.426766 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-20b2eefe-2d5e-4b8c-b058-1f9541799a94 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ba2bdb71-bf73-4a51-b56a-7c36579882f8"}} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:09:31.427972 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-20b2eefe-2d5e-4b8c-b058-1f9541799a94 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:09:31.434114 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-20b2eefe-2d5e-4b8c-b058-1f9541799a94 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:31.434576 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-20b2eefe-2d5e-4b8c-b058-1f9541799a94 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:31.435370 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-20b2eefe-2d5e-4b8c-b058-1f9541799a94 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:31.435800 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-20b2eefe-2d5e-4b8c-b058-1f9541799a94 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:32.003818 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:09:32.634301 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-20b2eefe-2d5e-4b8c-b058-1f9541799a94 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "POST /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.212100 Jul 21 20:09:32.634914 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 267/515] 10.222.0.58 () {62 vars in 1363 bytes} [Thu Jul 21 20:09:31 2022] POST /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f/os-volume_attachments => generated 188 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 20:09:32.750114 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-ee354513-7706-4cf2-b8b7-d2d7d0557f91 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:09:32.750673 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-ee354513-7706-4cf2-b8b7-d2d7d0557f91 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:09:32.757322 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-ee354513-7706-4cf2-b8b7-d2d7d0557f91 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:32.757762 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-ee354513-7706-4cf2-b8b7-d2d7d0557f91 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:32.758510 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-ee354513-7706-4cf2-b8b7-d2d7d0557f91 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:32.758935 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-ee354513-7706-4cf2-b8b7-d2d7d0557f91 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:32.996490 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-ee354513-7706-4cf2-b8b7-d2d7d0557f91 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "POST /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f/action" status: 202 len: 0 microversion: 2.20 time: 0.250150 Jul 21 20:09:32.997016 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 249/516] 10.222.0.58 () {62 vars in 1318 bytes} [Thu Jul 21 20:09:32 2022] POST /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f/action => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 21 20:09:33.005208 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-9392c1e0-6156-4250-a696-12df19aa8bdf tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:09:33.005811 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-9392c1e0-6156-4250-a696-12df19aa8bdf tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:09:33.011991 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-9392c1e0-6156-4250-a696-12df19aa8bdf tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:33.012436 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-9392c1e0-6156-4250-a696-12df19aa8bdf tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:33.013700 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-9392c1e0-6156-4250-a696-12df19aa8bdf tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:33.014130 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-9392c1e0-6156-4250-a696-12df19aa8bdf tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:33.146136 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-9392c1e0-6156-4250-a696-12df19aa8bdf tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:33.155220 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-9392c1e0-6156-4250-a696-12df19aa8bdf tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:33.156736 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-9392c1e0-6156-4250-a696-12df19aa8bdf tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:33.157933 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-9392c1e0-6156-4250-a696-12df19aa8bdf tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1749 microversion: 2.20 time: 0.156707 Jul 21 20:09:33.158496 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 268/517] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:09:33 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1749 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:09:34.177208 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-dd1fbb78-e501-4c7a-80d4-5b1ad86be80f tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:09:34.177812 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-dd1fbb78-e501-4c7a-80d4-5b1ad86be80f tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:09:34.186808 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-dd1fbb78-e501-4c7a-80d4-5b1ad86be80f tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:34.187276 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-dd1fbb78-e501-4c7a-80d4-5b1ad86be80f tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:34.188032 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-dd1fbb78-e501-4c7a-80d4-5b1ad86be80f tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:34.188457 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-dd1fbb78-e501-4c7a-80d4-5b1ad86be80f tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:34.317106 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-dd1fbb78-e501-4c7a-80d4-5b1ad86be80f tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:34.326201 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-dd1fbb78-e501-4c7a-80d4-5b1ad86be80f tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:34.327154 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-dd1fbb78-e501-4c7a-80d4-5b1ad86be80f tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:34.328332 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-dd1fbb78-e501-4c7a-80d4-5b1ad86be80f tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1749 microversion: 2.20 time: 0.155619 Jul 21 20:09:34.328900 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 250/518] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:09:34 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1749 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:09:35.346959 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-6c91267a-27bb-4fb7-b792-a891b5a0bb25 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:09:35.347614 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-6c91267a-27bb-4fb7-b792-a891b5a0bb25 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:09:35.353664 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6c91267a-27bb-4fb7-b792-a891b5a0bb25 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:35.354113 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6c91267a-27bb-4fb7-b792-a891b5a0bb25 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:35.354875 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6c91267a-27bb-4fb7-b792-a891b5a0bb25 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:35.355348 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6c91267a-27bb-4fb7-b792-a891b5a0bb25 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:35.483396 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-6c91267a-27bb-4fb7-b792-a891b5a0bb25 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:35.491837 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-6c91267a-27bb-4fb7-b792-a891b5a0bb25 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:35.493337 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-6c91267a-27bb-4fb7-b792-a891b5a0bb25 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:35.494480 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-6c91267a-27bb-4fb7-b792-a891b5a0bb25 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1751 microversion: 2.20 time: 0.151891 Jul 21 20:09:35.495066 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 269/519] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:09:35 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1751 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:09:36.514179 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-58b6b7de-9a93-4ab8-874c-c7d0322d43a2 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:09:36.514783 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-58b6b7de-9a93-4ab8-874c-c7d0322d43a2 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:09:36.521208 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-58b6b7de-9a93-4ab8-874c-c7d0322d43a2 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:36.521655 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-58b6b7de-9a93-4ab8-874c-c7d0322d43a2 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:36.522410 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-58b6b7de-9a93-4ab8-874c-c7d0322d43a2 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:36.522849 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-58b6b7de-9a93-4ab8-874c-c7d0322d43a2 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:36.656100 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-58b6b7de-9a93-4ab8-874c-c7d0322d43a2 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:36.664520 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-58b6b7de-9a93-4ab8-874c-c7d0322d43a2 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:36.666024 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-58b6b7de-9a93-4ab8-874c-c7d0322d43a2 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:36.667294 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-58b6b7de-9a93-4ab8-874c-c7d0322d43a2 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1751 microversion: 2.20 time: 0.157714 Jul 21 20:09:36.667846 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 251/520] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:09:36 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1751 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:09:37.685909 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-74b8d969-40ff-4748-be47-b39b618819e6 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:09:37.687169 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-74b8d969-40ff-4748-be47-b39b618819e6 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:09:37.693644 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-74b8d969-40ff-4748-be47-b39b618819e6 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:37.694296 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-74b8d969-40ff-4748-be47-b39b618819e6 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:37.695336 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-74b8d969-40ff-4748-be47-b39b618819e6 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:37.695932 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-74b8d969-40ff-4748-be47-b39b618819e6 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:37.826413 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-74b8d969-40ff-4748-be47-b39b618819e6 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:37.835181 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-74b8d969-40ff-4748-be47-b39b618819e6 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:37.836624 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-74b8d969-40ff-4748-be47-b39b618819e6 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:37.837778 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-74b8d969-40ff-4748-be47-b39b618819e6 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1807 microversion: 2.20 time: 0.156208 Jul 21 20:09:37.838339 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 270/521] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:09:37 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:09:38.858382 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-e557fec3-1589-48c5-9452-899668daf2ec tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:09:38.858972 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-e557fec3-1589-48c5-9452-899668daf2ec tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:09:38.865469 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-e557fec3-1589-48c5-9452-899668daf2ec tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:38.865913 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-e557fec3-1589-48c5-9452-899668daf2ec tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:38.866673 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-e557fec3-1589-48c5-9452-899668daf2ec tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:38.867133 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-e557fec3-1589-48c5-9452-899668daf2ec tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:38.996982 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-e557fec3-1589-48c5-9452-899668daf2ec tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:39.007449 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-e557fec3-1589-48c5-9452-899668daf2ec tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:39.014815 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-e557fec3-1589-48c5-9452-899668daf2ec tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:39.014815 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-e557fec3-1589-48c5-9452-899668daf2ec tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1807 microversion: 2.20 time: 0.156736 Jul 21 20:09:39.014815 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 252/522] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:09:38 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:09:40.031236 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-4332df18-229a-4435-8d2d-ff2c4e10eb7d tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:09:40.031789 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-4332df18-229a-4435-8d2d-ff2c4e10eb7d tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:09:40.038341 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4332df18-229a-4435-8d2d-ff2c4e10eb7d tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:40.038816 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4332df18-229a-4435-8d2d-ff2c4e10eb7d tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:40.039621 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4332df18-229a-4435-8d2d-ff2c4e10eb7d tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:40.040204 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4332df18-229a-4435-8d2d-ff2c4e10eb7d tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:40.174466 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-4332df18-229a-4435-8d2d-ff2c4e10eb7d tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:40.182914 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-4332df18-229a-4435-8d2d-ff2c4e10eb7d tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:40.184445 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-4332df18-229a-4435-8d2d-ff2c4e10eb7d tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:40.185582 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-4332df18-229a-4435-8d2d-ff2c4e10eb7d tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1807 microversion: 2.20 time: 0.158531 Jul 21 20:09:40.186163 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 271/523] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:09:40 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:09:41.204580 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-f4b05205-3671-4b76-89e0-14cb7e641bfd tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:09:41.205210 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-f4b05205-3671-4b76-89e0-14cb7e641bfd tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:09:41.211920 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f4b05205-3671-4b76-89e0-14cb7e641bfd tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:41.212364 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f4b05205-3671-4b76-89e0-14cb7e641bfd tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:41.213121 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f4b05205-3671-4b76-89e0-14cb7e641bfd tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:41.213555 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f4b05205-3671-4b76-89e0-14cb7e641bfd tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:41.353895 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-f4b05205-3671-4b76-89e0-14cb7e641bfd tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:41.364748 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-f4b05205-3671-4b76-89e0-14cb7e641bfd tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:41.366964 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-f4b05205-3671-4b76-89e0-14cb7e641bfd tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:41.368835 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-f4b05205-3671-4b76-89e0-14cb7e641bfd tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1807 microversion: 2.20 time: 0.168824 Jul 21 20:09:41.382853 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 253/524] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:09:41 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1807 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:09:42.391628 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-fc4c15d2-c218-415a-aa24-d9fb09a950e3 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:09:42.392219 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-fc4c15d2-c218-415a-aa24-d9fb09a950e3 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:09:42.398154 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-fc4c15d2-c218-415a-aa24-d9fb09a950e3 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:42.398600 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-fc4c15d2-c218-415a-aa24-d9fb09a950e3 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:42.399388 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-fc4c15d2-c218-415a-aa24-d9fb09a950e3 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:42.399819 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-fc4c15d2-c218-415a-aa24-d9fb09a950e3 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:42.536041 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-fc4c15d2-c218-415a-aa24-d9fb09a950e3 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:42.544290 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-fc4c15d2-c218-415a-aa24-d9fb09a950e3 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:42.545796 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-fc4c15d2-c218-415a-aa24-d9fb09a950e3 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:42.546944 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-fc4c15d2-c218-415a-aa24-d9fb09a950e3 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1807 microversion: 2.20 time: 0.159833 Jul 21 20:09:42.547524 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 272/525] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:09:42 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:09:43.566352 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-2e42a069-4063-4eb7-8003-ab9015513910 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:09:43.567242 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-2e42a069-4063-4eb7-8003-ab9015513910 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:09:43.574387 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-2e42a069-4063-4eb7-8003-ab9015513910 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:43.574918 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-2e42a069-4063-4eb7-8003-ab9015513910 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:43.576173 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-2e42a069-4063-4eb7-8003-ab9015513910 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:43.576678 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-2e42a069-4063-4eb7-8003-ab9015513910 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:43.777135 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-2e42a069-4063-4eb7-8003-ab9015513910 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:43.787014 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-2e42a069-4063-4eb7-8003-ab9015513910 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:43.789010 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-2e42a069-4063-4eb7-8003-ab9015513910 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:43.790381 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-2e42a069-4063-4eb7-8003-ab9015513910 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1807 microversion: 2.20 time: 0.228503 Jul 21 20:09:43.802686 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 254/526] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:09:43 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1807 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:09:44.811721 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-24eb17db-77f8-4b8a-b7c2-4da1c9f6b060 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:09:44.812282 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-24eb17db-77f8-4b8a-b7c2-4da1c9f6b060 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:09:44.818214 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-24eb17db-77f8-4b8a-b7c2-4da1c9f6b060 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:44.818661 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-24eb17db-77f8-4b8a-b7c2-4da1c9f6b060 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:44.819460 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-24eb17db-77f8-4b8a-b7c2-4da1c9f6b060 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:44.819892 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-24eb17db-77f8-4b8a-b7c2-4da1c9f6b060 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:44.968336 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-24eb17db-77f8-4b8a-b7c2-4da1c9f6b060 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:44.977060 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-24eb17db-77f8-4b8a-b7c2-4da1c9f6b060 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:44.978569 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-24eb17db-77f8-4b8a-b7c2-4da1c9f6b060 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:44.979780 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-24eb17db-77f8-4b8a-b7c2-4da1c9f6b060 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1807 microversion: 2.20 time: 0.172046 Jul 21 20:09:44.980310 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 273/527] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:09:44 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:09:45.999249 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-073751ad-81c3-4583-8ff8-836f3a073b20 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:09:45.999809 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-073751ad-81c3-4583-8ff8-836f3a073b20 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:09:46.006355 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-073751ad-81c3-4583-8ff8-836f3a073b20 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:46.006797 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-073751ad-81c3-4583-8ff8-836f3a073b20 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:46.007588 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-073751ad-81c3-4583-8ff8-836f3a073b20 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:46.008016 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-073751ad-81c3-4583-8ff8-836f3a073b20 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:46.144772 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-073751ad-81c3-4583-8ff8-836f3a073b20 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:46.154587 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-073751ad-81c3-4583-8ff8-836f3a073b20 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:46.156230 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-073751ad-81c3-4583-8ff8-836f3a073b20 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:46.157641 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-073751ad-81c3-4583-8ff8-836f3a073b20 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1807 microversion: 2.20 time: 0.163175 Jul 21 20:09:46.158561 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 255/528] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:09:45 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:09:47.176387 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-b1072bf7-4eb1-4730-b7d8-d988af00fde9 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:09:47.177278 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-b1072bf7-4eb1-4730-b7d8-d988af00fde9 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:09:47.183773 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b1072bf7-4eb1-4730-b7d8-d988af00fde9 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:47.184216 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b1072bf7-4eb1-4730-b7d8-d988af00fde9 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:47.184987 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b1072bf7-4eb1-4730-b7d8-d988af00fde9 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:47.185424 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b1072bf7-4eb1-4730-b7d8-d988af00fde9 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:47.377866 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-b1072bf7-4eb1-4730-b7d8-d988af00fde9 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:47.386143 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-b1072bf7-4eb1-4730-b7d8-d988af00fde9 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:47.388530 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-b1072bf7-4eb1-4730-b7d8-d988af00fde9 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:47.389844 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-b1072bf7-4eb1-4730-b7d8-d988af00fde9 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1807 microversion: 2.20 time: 0.217387 Jul 21 20:09:47.390415 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 274/529] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:09:47 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1807 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:09:48.408960 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-9f828d9a-e32c-4e0e-8c79-de203efaa63f tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:09:48.409578 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-9f828d9a-e32c-4e0e-8c79-de203efaa63f tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:09:48.416121 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-9f828d9a-e32c-4e0e-8c79-de203efaa63f tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:48.416576 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-9f828d9a-e32c-4e0e-8c79-de203efaa63f tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:48.417334 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-9f828d9a-e32c-4e0e-8c79-de203efaa63f tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:48.417767 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-9f828d9a-e32c-4e0e-8c79-de203efaa63f tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:48.568057 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-9f828d9a-e32c-4e0e-8c79-de203efaa63f tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:48.577300 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-9f828d9a-e32c-4e0e-8c79-de203efaa63f tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:48.578807 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-9f828d9a-e32c-4e0e-8c79-de203efaa63f tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:48.580041 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-9f828d9a-e32c-4e0e-8c79-de203efaa63f tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1807 microversion: 2.20 time: 0.175113 Jul 21 20:09:48.580800 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 256/530] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:09:48 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1807 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:09:49.598793 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-39336952-3f15-4a69-b3ba-85abd4009c06 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:09:49.601445 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-39336952-3f15-4a69-b3ba-85abd4009c06 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:09:49.605412 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-39336952-3f15-4a69-b3ba-85abd4009c06 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:49.605860 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-39336952-3f15-4a69-b3ba-85abd4009c06 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:49.607224 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-39336952-3f15-4a69-b3ba-85abd4009c06 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:49.607661 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-39336952-3f15-4a69-b3ba-85abd4009c06 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:49.744963 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-39336952-3f15-4a69-b3ba-85abd4009c06 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:49.746669 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-39336952-3f15-4a69-b3ba-85abd4009c06 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:49.748729 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-39336952-3f15-4a69-b3ba-85abd4009c06 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:49.749882 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-39336952-3f15-4a69-b3ba-85abd4009c06 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1807 microversion: 2.20 time: 0.155326 Jul 21 20:09:49.750449 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 275/531] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:09:49 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:09:50.677044 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-de64b223-cc63-4e51-98b9-a93b783ad055 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "400c7887-41b9-42a0-9afe-6c254423acb6"}} {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:09:50.679639 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-de64b223-cc63-4e51-98b9-a93b783ad055 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:09:50.691215 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-de64b223-cc63-4e51-98b9-a93b783ad055 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:50.691655 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-de64b223-cc63-4e51-98b9-a93b783ad055 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:50.692537 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-de64b223-cc63-4e51-98b9-a93b783ad055 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:50.692956 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-de64b223-cc63-4e51-98b9-a93b783ad055 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:50.767687 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-29c1c88e-4b5f-4426-9135-ec97514ee9e9 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:09:50.768292 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-29c1c88e-4b5f-4426-9135-ec97514ee9e9 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:09:50.774334 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-29c1c88e-4b5f-4426-9135-ec97514ee9e9 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:50.774776 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-29c1c88e-4b5f-4426-9135-ec97514ee9e9 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:50.775565 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-29c1c88e-4b5f-4426-9135-ec97514ee9e9 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:50.775992 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-29c1c88e-4b5f-4426-9135-ec97514ee9e9 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:50.907820 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-29c1c88e-4b5f-4426-9135-ec97514ee9e9 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:50.917299 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-29c1c88e-4b5f-4426-9135-ec97514ee9e9 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:50.919509 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-29c1c88e-4b5f-4426-9135-ec97514ee9e9 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:50.920593 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-29c1c88e-4b5f-4426-9135-ec97514ee9e9 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1807 microversion: 2.20 time: 0.156729 Jul 21 20:09:50.921150 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 276/532] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:09:50 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 20:09:51.947149 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-d1eda019-11ee-42c4-839b-a1fff65fcaf1 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:09:51.947789 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-d1eda019-11ee-42c4-839b-a1fff65fcaf1 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:09:51.954337 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d1eda019-11ee-42c4-839b-a1fff65fcaf1 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:51.954797 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d1eda019-11ee-42c4-839b-a1fff65fcaf1 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:51.955586 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d1eda019-11ee-42c4-839b-a1fff65fcaf1 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:51.956520 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d1eda019-11ee-42c4-839b-a1fff65fcaf1 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:52.085175 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-d1eda019-11ee-42c4-839b-a1fff65fcaf1 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:52.093567 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-d1eda019-11ee-42c4-839b-a1fff65fcaf1 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:52.095363 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-d1eda019-11ee-42c4-839b-a1fff65fcaf1 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:52.096515 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-d1eda019-11ee-42c4-839b-a1fff65fcaf1 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1807 microversion: 2.20 time: 0.155113 Jul 21 20:09:52.097096 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 277/533] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:09:51 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 20:09:52.497920 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 20:09:52.498386 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Thu Jul 21 20:09:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6/os-volume_attachments (ip 10.222.0.58) !!! Jul 21 20:09:53.115345 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-2096810c-e098-40f0-9222-abec6072f99e tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:09:53.116409 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-2096810c-e098-40f0-9222-abec6072f99e tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:09:53.121997 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2096810c-e098-40f0-9222-abec6072f99e tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:53.122437 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2096810c-e098-40f0-9222-abec6072f99e tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:53.123216 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2096810c-e098-40f0-9222-abec6072f99e tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:53.123644 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2096810c-e098-40f0-9222-abec6072f99e tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:53.250134 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-2096810c-e098-40f0-9222-abec6072f99e tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:53.258539 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-2096810c-e098-40f0-9222-abec6072f99e tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:53.260057 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-2096810c-e098-40f0-9222-abec6072f99e tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:53.261190 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-2096810c-e098-40f0-9222-abec6072f99e tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1807 microversion: 2.20 time: 0.149829 Jul 21 20:09:53.261740 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 278/534] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:09:53 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1807 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 20:09:54.281065 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-94aeb1c7-2128-4c06-b15f-6ab26e201f2c tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:09:54.281748 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-94aeb1c7-2128-4c06-b15f-6ab26e201f2c tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:09:54.287644 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-94aeb1c7-2128-4c06-b15f-6ab26e201f2c tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:54.288089 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-94aeb1c7-2128-4c06-b15f-6ab26e201f2c tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:54.288855 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-94aeb1c7-2128-4c06-b15f-6ab26e201f2c tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:54.289319 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-94aeb1c7-2128-4c06-b15f-6ab26e201f2c tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:54.420176 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-94aeb1c7-2128-4c06-b15f-6ab26e201f2c tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:54.428595 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-94aeb1c7-2128-4c06-b15f-6ab26e201f2c tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:54.430126 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-94aeb1c7-2128-4c06-b15f-6ab26e201f2c tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:54.431305 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-94aeb1c7-2128-4c06-b15f-6ab26e201f2c tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1807 microversion: 2.20 time: 0.154785 Jul 21 20:09:54.431865 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 279/535] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:09:54 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 20:09:54.699966 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG dbcounter [-] [118344] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:09:55.353046 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-de64b223-cc63-4e51-98b9-a93b783ad055 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "POST /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.679816 Jul 21 20:09:55.353606 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 257/536] 10.222.0.58 () {60 vars in 1322 bytes} [Thu Jul 21 20:09:50 2022] POST /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6/os-volume_attachments => generated 194 bytes in 4681 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:09:55.551214 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-a01ed6db-c9d6-4277-be92-59d166505d58 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:09:55.551822 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-a01ed6db-c9d6-4277-be92-59d166505d58 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:09:55.558017 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a01ed6db-c9d6-4277-be92-59d166505d58 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:55.558688 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a01ed6db-c9d6-4277-be92-59d166505d58 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:55.559922 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a01ed6db-c9d6-4277-be92-59d166505d58 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:55.560361 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a01ed6db-c9d6-4277-be92-59d166505d58 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:55.694590 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-a01ed6db-c9d6-4277-be92-59d166505d58 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:55.703542 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-a01ed6db-c9d6-4277-be92-59d166505d58 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:55.705155 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-a01ed6db-c9d6-4277-be92-59d166505d58 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:55.706196 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-a01ed6db-c9d6-4277-be92-59d166505d58 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1807 microversion: 2.20 time: 0.261005 Jul 21 20:09:55.706753 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 280/537] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:09:55 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1807 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:09:56.726360 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-3d122c33-c405-477f-acd8-43d33b23e122 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:09:56.726971 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-3d122c33-c405-477f-acd8-43d33b23e122 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:09:56.733922 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-3d122c33-c405-477f-acd8-43d33b23e122 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:56.734369 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-3d122c33-c405-477f-acd8-43d33b23e122 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:56.735167 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-3d122c33-c405-477f-acd8-43d33b23e122 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:56.735601 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-3d122c33-c405-477f-acd8-43d33b23e122 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:56.864022 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-3d122c33-c405-477f-acd8-43d33b23e122 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:56.872474 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-3d122c33-c405-477f-acd8-43d33b23e122 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:56.873963 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-3d122c33-c405-477f-acd8-43d33b23e122 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:56.875180 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-3d122c33-c405-477f-acd8-43d33b23e122 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1807 microversion: 2.20 time: 0.153674 Jul 21 20:09:56.875725 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 258/538] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:09:56 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:09:57.893789 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-7d8d5377-9f8d-4a7a-b21b-dea9a11bbf1a tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:09:57.894434 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-7d8d5377-9f8d-4a7a-b21b-dea9a11bbf1a tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:09:57.900450 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-7d8d5377-9f8d-4a7a-b21b-dea9a11bbf1a tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:57.900843 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-7d8d5377-9f8d-4a7a-b21b-dea9a11bbf1a tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:57.901592 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-7d8d5377-9f8d-4a7a-b21b-dea9a11bbf1a tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:57.902030 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-7d8d5377-9f8d-4a7a-b21b-dea9a11bbf1a tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:58.035694 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-7d8d5377-9f8d-4a7a-b21b-dea9a11bbf1a tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:58.044066 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-7d8d5377-9f8d-4a7a-b21b-dea9a11bbf1a tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:58.045556 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-7d8d5377-9f8d-4a7a-b21b-dea9a11bbf1a tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:58.046696 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-7d8d5377-9f8d-4a7a-b21b-dea9a11bbf1a tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1807 microversion: 2.20 time: 0.156871 Jul 21 20:09:58.047291 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 281/539] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:09:57 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:09:59.064164 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-a56478f4-4f36-4ad2-933c-17956699c350 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:09:59.064794 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-a56478f4-4f36-4ad2-933c-17956699c350 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:09:59.071388 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-a56478f4-4f36-4ad2-933c-17956699c350 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:59.071837 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-a56478f4-4f36-4ad2-933c-17956699c350 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:59.072602 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-a56478f4-4f36-4ad2-933c-17956699c350 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:09:59.073037 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-a56478f4-4f36-4ad2-933c-17956699c350 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:09:59.206184 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-a56478f4-4f36-4ad2-933c-17956699c350 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:59.214797 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-a56478f4-4f36-4ad2-933c-17956699c350 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:59.216392 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-a56478f4-4f36-4ad2-933c-17956699c350 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:09:59.217550 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-a56478f4-4f36-4ad2-933c-17956699c350 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1807 microversion: 2.20 time: 0.157383 Jul 21 20:09:59.218183 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 259/540] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:09:59 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:10:00.236636 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-8ec0461a-9869-4a99-8426-d5f8c9a72fc7 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:10:00.237611 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-8ec0461a-9869-4a99-8426-d5f8c9a72fc7 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:10:00.243765 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8ec0461a-9869-4a99-8426-d5f8c9a72fc7 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:00.244215 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8ec0461a-9869-4a99-8426-d5f8c9a72fc7 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:00.244972 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8ec0461a-9869-4a99-8426-d5f8c9a72fc7 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:00.245402 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8ec0461a-9869-4a99-8426-d5f8c9a72fc7 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:00.263820 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:10:00.381421 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-8ec0461a-9869-4a99-8426-d5f8c9a72fc7 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:10:00.389873 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-8ec0461a-9869-4a99-8426-d5f8c9a72fc7 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:10:00.391389 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-8ec0461a-9869-4a99-8426-d5f8c9a72fc7 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:10:00.392525 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-8ec0461a-9869-4a99-8426-d5f8c9a72fc7 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1807 microversion: 2.20 time: 0.159884 Jul 21 20:10:00.393140 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 282/541] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:10:00 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:10:01.410779 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-8a5dac0e-0534-483c-ab4d-b1f8b8518f79 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:10:01.411428 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-8a5dac0e-0534-483c-ab4d-b1f8b8518f79 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:10:01.413896 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG dbcounter [-] [118344] Writing DB stats nova_api:SELECT=26 {{(pid=118344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:10:01.419288 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-8a5dac0e-0534-483c-ab4d-b1f8b8518f79 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:01.419736 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-8a5dac0e-0534-483c-ab4d-b1f8b8518f79 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:01.420498 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-8a5dac0e-0534-483c-ab4d-b1f8b8518f79 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:01.420934 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-8a5dac0e-0534-483c-ab4d-b1f8b8518f79 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:01.545989 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-8a5dac0e-0534-483c-ab4d-b1f8b8518f79 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:10:01.554365 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-8a5dac0e-0534-483c-ab4d-b1f8b8518f79 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:10:01.555900 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-8a5dac0e-0534-483c-ab4d-b1f8b8518f79 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:10:01.557061 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-8a5dac0e-0534-483c-ab4d-b1f8b8518f79 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1807 microversion: 2.20 time: 0.150218 Jul 21 20:10:01.557622 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 260/542] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:10:01 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1807 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:10:02.575208 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-f7c837bf-79a0-4e28-afd5-9707be03a4d9 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:10:02.575809 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-f7c837bf-79a0-4e28-afd5-9707be03a4d9 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:10:02.577739 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_api:SELECT=34 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:10:02.582379 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f7c837bf-79a0-4e28-afd5-9707be03a4d9 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:02.582815 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f7c837bf-79a0-4e28-afd5-9707be03a4d9 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:02.592349 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f7c837bf-79a0-4e28-afd5-9707be03a4d9 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:02.592349 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f7c837bf-79a0-4e28-afd5-9707be03a4d9 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:02.718091 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-f7c837bf-79a0-4e28-afd5-9707be03a4d9 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:10:02.727178 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-f7c837bf-79a0-4e28-afd5-9707be03a4d9 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:10:02.728683 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-f7c837bf-79a0-4e28-afd5-9707be03a4d9 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:10:02.729823 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-f7c837bf-79a0-4e28-afd5-9707be03a4d9 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1807 microversion: 2.20 time: 0.158602 Jul 21 20:10:02.730382 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 283/543] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:10:02 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:10:03.749134 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-9a368caa-b35d-44cb-8dbc-a281db76298d tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:10:03.749732 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-9a368caa-b35d-44cb-8dbc-a281db76298d tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:10:03.756312 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-9a368caa-b35d-44cb-8dbc-a281db76298d tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:03.756753 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-9a368caa-b35d-44cb-8dbc-a281db76298d tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:03.757497 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-9a368caa-b35d-44cb-8dbc-a281db76298d tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:03.757924 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-9a368caa-b35d-44cb-8dbc-a281db76298d tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:03.889517 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-9a368caa-b35d-44cb-8dbc-a281db76298d tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:10:03.897794 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-9a368caa-b35d-44cb-8dbc-a281db76298d tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:10:03.899366 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-9a368caa-b35d-44cb-8dbc-a281db76298d tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:10:03.900518 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-9a368caa-b35d-44cb-8dbc-a281db76298d tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1807 microversion: 2.20 time: 0.156008 Jul 21 20:10:03.901081 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 261/544] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:10:03 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:10:04.021994 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-80cb8b69-0a7e-4b8a-a96f-1a7d3e4d50e5 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:10:04.023014 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-80cb8b69-0a7e-4b8a-a96f-1a7d3e4d50e5 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:10:04.028980 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-80cb8b69-0a7e-4b8a-a96f-1a7d3e4d50e5 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:04.029458 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-80cb8b69-0a7e-4b8a-a96f-1a7d3e4d50e5 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:04.030220 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-80cb8b69-0a7e-4b8a-a96f-1a7d3e4d50e5 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:04.030655 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-80cb8b69-0a7e-4b8a-a96f-1a7d3e4d50e5 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:04.052775 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.objects.instance [None req-80cb8b69-0a7e-4b8a-a96f-1a7d3e4d50e5 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lazy-loading 'flavor' on Instance uuid 5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6 {{(pid=118345) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 20:10:04.381958 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-80cb8b69-0a7e-4b8a-a96f-1a7d3e4d50e5 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "POST /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6/action" status: 200 len: 32 microversion: 2.1 time: 0.363841 Jul 21 20:10:04.386472 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 284/545] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Jul 21 20:10:04 2022] POST /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6/action => generated 32 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 21 20:10:04.392013 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-a5106bf8-87f1-4a64-9246-2f08d586eb1f tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:10:04.392435 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-a5106bf8-87f1-4a64-9246-2f08d586eb1f tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:10:04.398485 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-a5106bf8-87f1-4a64-9246-2f08d586eb1f tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:04.398932 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-a5106bf8-87f1-4a64-9246-2f08d586eb1f tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:04.399735 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-a5106bf8-87f1-4a64-9246-2f08d586eb1f tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:04.400167 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-a5106bf8-87f1-4a64-9246-2f08d586eb1f tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:04.532552 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-a5106bf8-87f1-4a64-9246-2f08d586eb1f tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:10:04.540854 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-a5106bf8-87f1-4a64-9246-2f08d586eb1f tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6" status: 200 len: 1737 microversion: 2.1 time: 0.152856 Jul 21 20:10:04.541481 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 262/546] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:10:04 2022] GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:10:04.919749 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-0dcc5e01-2291-4138-84fa-45bbdf3c36b7 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:10:04.921451 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-0dcc5e01-2291-4138-84fa-45bbdf3c36b7 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:10:04.928897 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0dcc5e01-2291-4138-84fa-45bbdf3c36b7 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:04.929349 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0dcc5e01-2291-4138-84fa-45bbdf3c36b7 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:04.930046 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [req-0f43f544-197e-4887-a71d-1c0b69492845 req-39a4436f-08d2-4c8d-acb2-1ab75d0174b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b07e385b-3d8f-4370-a8fc-013a1c785c0f", "name": "network-vif-plugged", "status": "completed", "tag": "b6f7db3f-a2e0-4b71-a01c-2b805c7bf070"}]} {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:10:04.930485 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0dcc5e01-2291-4138-84fa-45bbdf3c36b7 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:04.930744 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0dcc5e01-2291-4138-84fa-45bbdf3c36b7 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:04.939734 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [req-0f43f544-197e-4887-a71d-1c0b69492845 req-39a4436f-08d2-4c8d-acb2-1ab75d0174b3 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:04.940364 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [req-0f43f544-197e-4887-a71d-1c0b69492845 req-39a4436f-08d2-4c8d-acb2-1ab75d0174b3 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:04.952827 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.compute.server_external_events [req-0f43f544-197e-4887-a71d-1c0b69492845 req-39a4436f-08d2-4c8d-acb2-1ab75d0174b3 service nova] Creating event network-vif-plugged:b6f7db3f-a2e0-4b71-a01c-2b805c7bf070 for instance b07e385b-3d8f-4370-a8fc-013a1c785c0f on hv-cinder-85054 Jul 21 20:10:04.958127 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [req-0f43f544-197e-4887-a71d-1c0b69492845 req-39a4436f-08d2-4c8d-acb2-1ab75d0174b3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034935 Jul 21 20:10:04.963074 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 263/547] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 20:10:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:10:05.136269 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-0dcc5e01-2291-4138-84fa-45bbdf3c36b7 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:10:05.144782 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-0dcc5e01-2291-4138-84fa-45bbdf3c36b7 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:10:05.146423 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-0dcc5e01-2291-4138-84fa-45bbdf3c36b7 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:10:05.147490 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-0dcc5e01-2291-4138-84fa-45bbdf3c36b7 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1807 microversion: 2.20 time: 0.232486 Jul 21 20:10:05.148045 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 285/548] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:10:04 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1807 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:10:05.558196 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-fb4ef63e-a9ce-48e5-a84c-187259982557 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:10:05.559066 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-fb4ef63e-a9ce-48e5-a84c-187259982557 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:10:05.565675 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-fb4ef63e-a9ce-48e5-a84c-187259982557 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:05.566117 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-fb4ef63e-a9ce-48e5-a84c-187259982557 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:05.566873 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-fb4ef63e-a9ce-48e5-a84c-187259982557 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:05.567422 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-fb4ef63e-a9ce-48e5-a84c-187259982557 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:05.695271 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-fb4ef63e-a9ce-48e5-a84c-187259982557 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:10:05.703203 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-fb4ef63e-a9ce-48e5-a84c-187259982557 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6" status: 200 len: 1737 microversion: 2.1 time: 0.149134 Jul 21 20:10:05.703764 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 264/549] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:10:05 2022] GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6 => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:10:06.166061 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-3420d591-9919-495d-9e10-4d3ee3e66c5a tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:10:06.166653 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-3420d591-9919-495d-9e10-4d3ee3e66c5a tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:10:06.172743 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3420d591-9919-495d-9e10-4d3ee3e66c5a tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:06.173176 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3420d591-9919-495d-9e10-4d3ee3e66c5a tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:06.173915 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3420d591-9919-495d-9e10-4d3ee3e66c5a tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:06.174343 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3420d591-9919-495d-9e10-4d3ee3e66c5a tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:06.300415 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-3420d591-9919-495d-9e10-4d3ee3e66c5a tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:10:06.308696 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-3420d591-9919-495d-9e10-4d3ee3e66c5a tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:10:06.310179 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-3420d591-9919-495d-9e10-4d3ee3e66c5a tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:10:06.311349 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-3420d591-9919-495d-9e10-4d3ee3e66c5a tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1807 microversion: 2.20 time: 0.149200 Jul 21 20:10:06.311902 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 286/550] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:10:06 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1807 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:10:06.719520 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-801b6b66-87ce-4146-b53f-42891dd95060 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:10:06.720401 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-801b6b66-87ce-4146-b53f-42891dd95060 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:10:06.727182 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-801b6b66-87ce-4146-b53f-42891dd95060 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:06.727630 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-801b6b66-87ce-4146-b53f-42891dd95060 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:06.728427 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-801b6b66-87ce-4146-b53f-42891dd95060 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:06.728862 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-801b6b66-87ce-4146-b53f-42891dd95060 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:07.067894 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-801b6b66-87ce-4146-b53f-42891dd95060 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:10:07.075752 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-801b6b66-87ce-4146-b53f-42891dd95060 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6" status: 200 len: 1737 microversion: 2.1 time: 0.360148 Jul 21 20:10:07.076812 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 265/551] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:10:06 2022] GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6 => generated 1737 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:10:07.330224 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-dd8d6d31-ac71-45f3-a975-1b835e50ed20 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:10:07.330776 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-dd8d6d31-ac71-45f3-a975-1b835e50ed20 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:10:07.336812 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-dd8d6d31-ac71-45f3-a975-1b835e50ed20 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:07.337256 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-dd8d6d31-ac71-45f3-a975-1b835e50ed20 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:07.338007 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-dd8d6d31-ac71-45f3-a975-1b835e50ed20 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:07.338439 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-dd8d6d31-ac71-45f3-a975-1b835e50ed20 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:07.468949 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-dd8d6d31-ac71-45f3-a975-1b835e50ed20 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:10:07.476921 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-dd8d6d31-ac71-45f3-a975-1b835e50ed20 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:10:07.478421 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-dd8d6d31-ac71-45f3-a975-1b835e50ed20 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:10:07.479601 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-dd8d6d31-ac71-45f3-a975-1b835e50ed20 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1807 microversion: 2.20 time: 0.153949 Jul 21 20:10:07.480150 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 287/552] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:10:07 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:10:08.093606 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-7065fd75-b809-4bf9-bf25-876169b4be3b tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:10:08.094215 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-7065fd75-b809-4bf9-bf25-876169b4be3b tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:10:08.100716 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-7065fd75-b809-4bf9-bf25-876169b4be3b tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:08.101093 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-7065fd75-b809-4bf9-bf25-876169b4be3b tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:08.101895 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-7065fd75-b809-4bf9-bf25-876169b4be3b tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:08.102337 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-7065fd75-b809-4bf9-bf25-876169b4be3b tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:08.230883 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-7065fd75-b809-4bf9-bf25-876169b4be3b tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:10:08.239549 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-7065fd75-b809-4bf9-bf25-876169b4be3b tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6" status: 200 len: 1737 microversion: 2.1 time: 0.150338 Jul 21 20:10:08.240228 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 266/553] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:10:08 2022] GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6 => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:10:08.497910 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-cc006ee2-e4f6-49f2-97b6-685cc06f06a4 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:10:08.499122 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-cc006ee2-e4f6-49f2-97b6-685cc06f06a4 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:10:08.505295 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-cc006ee2-e4f6-49f2-97b6-685cc06f06a4 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:08.505737 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-cc006ee2-e4f6-49f2-97b6-685cc06f06a4 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:08.506491 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-cc006ee2-e4f6-49f2-97b6-685cc06f06a4 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:08.506919 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-cc006ee2-e4f6-49f2-97b6-685cc06f06a4 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:08.635489 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-cc006ee2-e4f6-49f2-97b6-685cc06f06a4 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:10:08.644033 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-cc006ee2-e4f6-49f2-97b6-685cc06f06a4 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:10:08.645530 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-cc006ee2-e4f6-49f2-97b6-685cc06f06a4 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:10:08.646680 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-cc006ee2-e4f6-49f2-97b6-685cc06f06a4 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1807 microversion: 2.20 time: 0.152661 Jul 21 20:10:08.647267 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 288/554] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:10:08 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:10:09.256880 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-6a38374d-822b-4f7e-98ff-4bfcf2ee9433 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:10:09.257574 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-6a38374d-822b-4f7e-98ff-4bfcf2ee9433 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:10:09.264467 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-6a38374d-822b-4f7e-98ff-4bfcf2ee9433 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:09.264916 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-6a38374d-822b-4f7e-98ff-4bfcf2ee9433 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:09.265683 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-6a38374d-822b-4f7e-98ff-4bfcf2ee9433 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:09.266117 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-6a38374d-822b-4f7e-98ff-4bfcf2ee9433 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:09.401703 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-6a38374d-822b-4f7e-98ff-4bfcf2ee9433 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:10:09.410510 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-6a38374d-822b-4f7e-98ff-4bfcf2ee9433 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6" status: 200 len: 1737 microversion: 2.1 time: 0.157712 Jul 21 20:10:09.411914 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 267/555] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:10:09 2022] GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6 => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:10:09.665433 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-55e4ec79-c76d-412b-a288-bd9daa8cdf62 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:10:09.666027 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-55e4ec79-c76d-412b-a288-bd9daa8cdf62 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:10:09.672703 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-55e4ec79-c76d-412b-a288-bd9daa8cdf62 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:09.673135 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-55e4ec79-c76d-412b-a288-bd9daa8cdf62 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:09.673877 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-55e4ec79-c76d-412b-a288-bd9daa8cdf62 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:09.674330 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-55e4ec79-c76d-412b-a288-bd9daa8cdf62 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:10.037316 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-55e4ec79-c76d-412b-a288-bd9daa8cdf62 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:10:10.045764 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-55e4ec79-c76d-412b-a288-bd9daa8cdf62 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:10:10.047298 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-55e4ec79-c76d-412b-a288-bd9daa8cdf62 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:10:10.048457 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-55e4ec79-c76d-412b-a288-bd9daa8cdf62 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1794 microversion: 2.20 time: 0.387087 Jul 21 20:10:10.049017 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 289/556] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:10:09 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1794 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:10:10.428006 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-908e883f-bb0a-4c0b-97f4-d26d9573673d tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:10:10.428631 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-908e883f-bb0a-4c0b-97f4-d26d9573673d tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:10:10.435062 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-908e883f-bb0a-4c0b-97f4-d26d9573673d tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:10.437533 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-908e883f-bb0a-4c0b-97f4-d26d9573673d tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:10.437533 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-908e883f-bb0a-4c0b-97f4-d26d9573673d tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:10.437533 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-908e883f-bb0a-4c0b-97f4-d26d9573673d tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:10.565564 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-908e883f-bb0a-4c0b-97f4-d26d9573673d tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:10:10.573658 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-908e883f-bb0a-4c0b-97f4-d26d9573673d tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6" status: 200 len: 1737 microversion: 2.1 time: 0.149647 Jul 21 20:10:10.574224 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 268/557] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:10:10 2022] GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6 => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:10:11.590706 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-36c31a43-2ce0-497d-b733-d66d8a9d9422 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:10:11.591382 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-36c31a43-2ce0-497d-b733-d66d8a9d9422 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:10:11.598068 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-36c31a43-2ce0-497d-b733-d66d8a9d9422 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:11.598504 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-36c31a43-2ce0-497d-b733-d66d8a9d9422 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:11.599277 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-36c31a43-2ce0-497d-b733-d66d8a9d9422 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:11.599702 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-36c31a43-2ce0-497d-b733-d66d8a9d9422 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:11.725790 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-36c31a43-2ce0-497d-b733-d66d8a9d9422 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:10:11.734141 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-36c31a43-2ce0-497d-b733-d66d8a9d9422 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6" status: 200 len: 1737 microversion: 2.1 time: 0.147919 Jul 21 20:10:11.734703 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 290/558] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:10:11 2022] GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6 => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:10:12.751072 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-bd7a1906-825b-4571-b928-91884b2ed0b6 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:10:12.751916 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-bd7a1906-825b-4571-b928-91884b2ed0b6 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:10:12.758476 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-bd7a1906-825b-4571-b928-91884b2ed0b6 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:12.758862 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-bd7a1906-825b-4571-b928-91884b2ed0b6 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:12.759649 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-bd7a1906-825b-4571-b928-91884b2ed0b6 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:12.760080 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-bd7a1906-825b-4571-b928-91884b2ed0b6 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:12.891406 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-bd7a1906-825b-4571-b928-91884b2ed0b6 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:10:12.899326 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-bd7a1906-825b-4571-b928-91884b2ed0b6 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6" status: 200 len: 1737 microversion: 2.1 time: 0.152175 Jul 21 20:10:12.899892 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 269/559] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:10:12 2022] GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:10:13.916500 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-dd9dfb7e-18c6-40ec-bca6-5a3f9ee30ff1 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:10:13.917036 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-dd9dfb7e-18c6-40ec-bca6-5a3f9ee30ff1 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:10:13.923092 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-dd9dfb7e-18c6-40ec-bca6-5a3f9ee30ff1 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:13.923539 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-dd9dfb7e-18c6-40ec-bca6-5a3f9ee30ff1 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:13.924293 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-dd9dfb7e-18c6-40ec-bca6-5a3f9ee30ff1 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:13.924723 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-dd9dfb7e-18c6-40ec-bca6-5a3f9ee30ff1 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:14.055564 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-dd9dfb7e-18c6-40ec-bca6-5a3f9ee30ff1 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:10:14.064086 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-dd9dfb7e-18c6-40ec-bca6-5a3f9ee30ff1 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6" status: 200 len: 1737 microversion: 2.1 time: 0.151563 Jul 21 20:10:14.064685 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 291/560] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:10:13 2022] GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:10:15.080778 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-f283b11a-f5be-49e6-a569-1327ceede384 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:10:15.081407 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-f283b11a-f5be-49e6-a569-1327ceede384 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:10:15.088081 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f283b11a-f5be-49e6-a569-1327ceede384 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:15.088528 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f283b11a-f5be-49e6-a569-1327ceede384 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:15.089291 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f283b11a-f5be-49e6-a569-1327ceede384 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:15.089723 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f283b11a-f5be-49e6-a569-1327ceede384 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:15.217296 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-f283b11a-f5be-49e6-a569-1327ceede384 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:10:15.225462 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-f283b11a-f5be-49e6-a569-1327ceede384 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6" status: 200 len: 1737 microversion: 2.1 time: 0.148585 Jul 21 20:10:15.226025 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 270/561] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:10:15 2022] GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6 => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:10:16.242929 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-8aece8ef-05c3-4244-8cb6-45a37848dea1 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:10:16.243561 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-8aece8ef-05c3-4244-8cb6-45a37848dea1 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:10:16.249549 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8aece8ef-05c3-4244-8cb6-45a37848dea1 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:16.249994 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8aece8ef-05c3-4244-8cb6-45a37848dea1 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:16.250746 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8aece8ef-05c3-4244-8cb6-45a37848dea1 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:16.251215 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8aece8ef-05c3-4244-8cb6-45a37848dea1 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:16.378755 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-8aece8ef-05c3-4244-8cb6-45a37848dea1 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:10:16.386678 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-8aece8ef-05c3-4244-8cb6-45a37848dea1 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6" status: 200 len: 1737 microversion: 2.1 time: 0.147595 Jul 21 20:10:16.387269 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 292/562] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:10:16 2022] GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6 => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:10:17.403303 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-6a2d9238-f950-4ecc-af1f-815413911ebe tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:10:17.403911 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-6a2d9238-f950-4ecc-af1f-815413911ebe tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:10:17.410677 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-6a2d9238-f950-4ecc-af1f-815413911ebe tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:17.411147 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-6a2d9238-f950-4ecc-af1f-815413911ebe tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:17.411957 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-6a2d9238-f950-4ecc-af1f-815413911ebe tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:17.412380 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-6a2d9238-f950-4ecc-af1f-815413911ebe tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:17.538221 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-6a2d9238-f950-4ecc-af1f-815413911ebe tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:10:17.546090 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-6a2d9238-f950-4ecc-af1f-815413911ebe tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6" status: 200 len: 1737 microversion: 2.1 time: 0.146818 Jul 21 20:10:17.548341 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 271/563] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:10:17 2022] GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6 => generated 1737 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:10:18.565858 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-ad1271c7-756e-498b-a0f7-f63234bdd429 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:10:18.566493 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-ad1271c7-756e-498b-a0f7-f63234bdd429 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:10:18.572584 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ad1271c7-756e-498b-a0f7-f63234bdd429 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:18.573018 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ad1271c7-756e-498b-a0f7-f63234bdd429 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:18.573763 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ad1271c7-756e-498b-a0f7-f63234bdd429 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:18.574188 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ad1271c7-756e-498b-a0f7-f63234bdd429 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:18.700823 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-ad1271c7-756e-498b-a0f7-f63234bdd429 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:10:18.708924 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-ad1271c7-756e-498b-a0f7-f63234bdd429 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6" status: 200 len: 1737 microversion: 2.1 time: 0.147561 Jul 21 20:10:18.709538 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 293/564] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:10:18 2022] GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6 => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:10:19.726726 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-9a98fc1b-db04-4097-a221-caffd0b071c0 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:10:19.727360 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-9a98fc1b-db04-4097-a221-caffd0b071c0 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:10:19.733835 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-9a98fc1b-db04-4097-a221-caffd0b071c0 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:19.734302 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-9a98fc1b-db04-4097-a221-caffd0b071c0 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:19.735114 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-9a98fc1b-db04-4097-a221-caffd0b071c0 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:19.735552 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-9a98fc1b-db04-4097-a221-caffd0b071c0 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:19.866676 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-9a98fc1b-db04-4097-a221-caffd0b071c0 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:10:19.874727 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-9a98fc1b-db04-4097-a221-caffd0b071c0 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6" status: 200 len: 1737 microversion: 2.1 time: 0.151830 Jul 21 20:10:19.875267 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 272/565] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:10:19 2022] GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:10:20.891813 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-8ede1e2f-1578-45bd-975d-60aa4375177a tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:10:20.892423 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-8ede1e2f-1578-45bd-975d-60aa4375177a tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:10:20.898426 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8ede1e2f-1578-45bd-975d-60aa4375177a tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:20.898871 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8ede1e2f-1578-45bd-975d-60aa4375177a tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:20.899663 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8ede1e2f-1578-45bd-975d-60aa4375177a tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:20.900094 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8ede1e2f-1578-45bd-975d-60aa4375177a tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:21.029440 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-8ede1e2f-1578-45bd-975d-60aa4375177a tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:10:21.037409 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-8ede1e2f-1578-45bd-975d-60aa4375177a tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6" status: 200 len: 1737 microversion: 2.1 time: 0.149460 Jul 21 20:10:21.037979 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 294/566] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:10:20 2022] GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6 => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:10:22.054819 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-a04024e7-bf31-4b4b-af8f-65d73726d282 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:10:22.055424 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-a04024e7-bf31-4b4b-af8f-65d73726d282 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:10:22.061833 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-a04024e7-bf31-4b4b-af8f-65d73726d282 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:22.062284 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-a04024e7-bf31-4b4b-af8f-65d73726d282 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:22.063068 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-a04024e7-bf31-4b4b-af8f-65d73726d282 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:22.063524 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-a04024e7-bf31-4b4b-af8f-65d73726d282 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:22.190022 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-a04024e7-bf31-4b4b-af8f-65d73726d282 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:10:22.198506 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-a04024e7-bf31-4b4b-af8f-65d73726d282 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6" status: 200 len: 1737 microversion: 2.1 time: 0.147779 Jul 21 20:10:22.199088 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 273/567] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:10:22 2022] GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6 => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:10:23.216254 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-3d737fd3-e1bb-479f-ba7f-5493c2d53afb tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:10:23.216862 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-3d737fd3-e1bb-479f-ba7f-5493c2d53afb tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:10:23.223903 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3d737fd3-e1bb-479f-ba7f-5493c2d53afb tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:23.224349 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3d737fd3-e1bb-479f-ba7f-5493c2d53afb tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:23.225113 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3d737fd3-e1bb-479f-ba7f-5493c2d53afb tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:23.225547 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3d737fd3-e1bb-479f-ba7f-5493c2d53afb tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:23.354974 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-3d737fd3-e1bb-479f-ba7f-5493c2d53afb tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:10:23.362804 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-3d737fd3-e1bb-479f-ba7f-5493c2d53afb tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6" status: 200 len: 1737 microversion: 2.1 time: 0.150455 Jul 21 20:10:23.363408 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 295/568] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:10:23 2022] GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6 => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:10:24.380027 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-38368ab5-2d12-4ae4-a682-e8007a285995 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:10:24.380638 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-38368ab5-2d12-4ae4-a682-e8007a285995 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:10:24.387102 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-38368ab5-2d12-4ae4-a682-e8007a285995 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:24.387534 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-38368ab5-2d12-4ae4-a682-e8007a285995 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:24.388288 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-38368ab5-2d12-4ae4-a682-e8007a285995 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:24.388722 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-38368ab5-2d12-4ae4-a682-e8007a285995 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:24.391363 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG dbcounter [-] [118344] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=118344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:10:24.521451 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-38368ab5-2d12-4ae4-a682-e8007a285995 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:10:24.531163 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-38368ab5-2d12-4ae4-a682-e8007a285995 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6" status: 200 len: 1737 microversion: 2.1 time: 0.154985 Jul 21 20:10:24.531730 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 274/569] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:10:24 2022] GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6 => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:10:25.549101 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-9e59cd59-0091-438a-82a5-b83d9ffcccfc tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:10:25.549681 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-9e59cd59-0091-438a-82a5-b83d9ffcccfc tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:10:25.556305 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-9e59cd59-0091-438a-82a5-b83d9ffcccfc tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:25.556749 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-9e59cd59-0091-438a-82a5-b83d9ffcccfc tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:25.557499 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-9e59cd59-0091-438a-82a5-b83d9ffcccfc tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:25.557922 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-9e59cd59-0091-438a-82a5-b83d9ffcccfc tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:25.711479 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-9e59cd59-0091-438a-82a5-b83d9ffcccfc tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:10:25.720428 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-9e59cd59-0091-438a-82a5-b83d9ffcccfc tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6" status: 200 len: 1737 microversion: 2.1 time: 0.174826 Jul 21 20:10:25.721000 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 296/570] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:10:25 2022] GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6 => generated 1737 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:10:26.737711 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-8dfae3de-0941-445e-ad3b-76bf1e33bd71 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:10:26.738338 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-8dfae3de-0941-445e-ad3b-76bf1e33bd71 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:10:26.744942 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-8dfae3de-0941-445e-ad3b-76bf1e33bd71 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:26.745385 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-8dfae3de-0941-445e-ad3b-76bf1e33bd71 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:26.746136 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-8dfae3de-0941-445e-ad3b-76bf1e33bd71 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:26.746566 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-8dfae3de-0941-445e-ad3b-76bf1e33bd71 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:26.876679 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-8dfae3de-0941-445e-ad3b-76bf1e33bd71 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:10:26.885292 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-8dfae3de-0941-445e-ad3b-76bf1e33bd71 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6" status: 200 len: 1737 microversion: 2.1 time: 0.151539 Jul 21 20:10:26.885859 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 275/571] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:10:26 2022] GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:10:27.902554 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-91bbfdf1-bbfd-4acd-8e26-08b2386e972c tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:10:27.903183 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-91bbfdf1-bbfd-4acd-8e26-08b2386e972c tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:10:27.910308 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-91bbfdf1-bbfd-4acd-8e26-08b2386e972c tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:27.910747 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-91bbfdf1-bbfd-4acd-8e26-08b2386e972c tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:27.911546 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-91bbfdf1-bbfd-4acd-8e26-08b2386e972c tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:27.912028 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-91bbfdf1-bbfd-4acd-8e26-08b2386e972c tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:27.916384 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:10:28.039614 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-91bbfdf1-bbfd-4acd-8e26-08b2386e972c tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:10:28.047417 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-91bbfdf1-bbfd-4acd-8e26-08b2386e972c tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6" status: 200 len: 1737 microversion: 2.1 time: 0.149224 Jul 21 20:10:28.047978 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 297/572] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:10:27 2022] GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6 => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:10:29.064448 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-ac8d362a-f8c9-4ccf-8d69-f90be884add0 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:10:29.065083 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-ac8d362a-f8c9-4ccf-8d69-f90be884add0 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:10:29.071735 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-ac8d362a-f8c9-4ccf-8d69-f90be884add0 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:29.072175 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-ac8d362a-f8c9-4ccf-8d69-f90be884add0 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:29.072929 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-ac8d362a-f8c9-4ccf-8d69-f90be884add0 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:29.073360 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-ac8d362a-f8c9-4ccf-8d69-f90be884add0 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:29.200670 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-ac8d362a-f8c9-4ccf-8d69-f90be884add0 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:10:29.209088 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-ac8d362a-f8c9-4ccf-8d69-f90be884add0 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6" status: 200 len: 1737 microversion: 2.1 time: 0.148558 Jul 21 20:10:29.209742 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 276/573] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:10:29 2022] GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6 => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:10:30.227046 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-55b34e91-a872-4f63-82d9-0227db3d8097 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:10:30.227648 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-55b34e91-a872-4f63-82d9-0227db3d8097 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:10:30.233677 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-55b34e91-a872-4f63-82d9-0227db3d8097 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:30.244312 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-55b34e91-a872-4f63-82d9-0227db3d8097 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:30.244312 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-55b34e91-a872-4f63-82d9-0227db3d8097 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:30.244312 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-55b34e91-a872-4f63-82d9-0227db3d8097 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:30.364410 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-55b34e91-a872-4f63-82d9-0227db3d8097 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:10:30.372490 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-55b34e91-a872-4f63-82d9-0227db3d8097 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6" status: 200 len: 1737 microversion: 2.1 time: 0.149386 Jul 21 20:10:30.373052 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 298/574] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:10:30 2022] GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6 => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:10:31.389902 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-3edec7b4-37a2-4aed-a0c7-f3f46c057ba3 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:10:31.390488 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-3edec7b4-37a2-4aed-a0c7-f3f46c057ba3 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:10:31.397154 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-3edec7b4-37a2-4aed-a0c7-f3f46c057ba3 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:31.397689 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-3edec7b4-37a2-4aed-a0c7-f3f46c057ba3 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:31.398467 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-3edec7b4-37a2-4aed-a0c7-f3f46c057ba3 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:31.398896 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-3edec7b4-37a2-4aed-a0c7-f3f46c057ba3 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:31.528169 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-3edec7b4-37a2-4aed-a0c7-f3f46c057ba3 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:10:31.535995 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-3edec7b4-37a2-4aed-a0c7-f3f46c057ba3 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6" status: 200 len: 1717 microversion: 2.1 time: 0.150215 Jul 21 20:10:31.536578 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 277/575] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:10:31 2022] GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6 => generated 1717 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:10:31.589735 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-636bfd4a-5ca4-4af9-8651-799867e9234f tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:10:31.590213 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-636bfd4a-5ca4-4af9-8651-799867e9234f tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:10:31.596462 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-636bfd4a-5ca4-4af9-8651-799867e9234f tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:31.596903 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-636bfd4a-5ca4-4af9-8651-799867e9234f tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:31.597658 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-636bfd4a-5ca4-4af9-8651-799867e9234f tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:31.598088 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-636bfd4a-5ca4-4af9-8651-799867e9234f tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:31.718452 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.wsgi [None req-636bfd4a-5ca4-4af9-8651-799867e9234f tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] HTTP exception thrown: Cannot 'detach_volume' instance 5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6 while it is in vm_state rescued Jul 21 20:10:31.720431 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-636bfd4a-5ca4-4af9-8651-799867e9234f tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Request method failure captured: Jul 21 20:10:31.720431 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: request: DELETE /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6/os-volume_attachments/400c7887-41b9-42a0-9afe-6c254423acb6 HTTP/1.1 Jul 21 20:10:31.720431 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Accept: application/json Jul 21 20:10:31.720431 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Accept-Encoding: identity Jul 21 20:10:31.720431 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Connection: close Jul 21 20:10:31.720431 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Content-Length: 0 Jul 21 20:10:31.720431 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Content-Type: application/json Jul 21 20:10:31.720431 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Host: 10.222.0.58 Jul 21 20:10:31.720431 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Openstack-System-Scope: None Jul 21 20:10:31.720431 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: User-Agent: python-urllib3/1.26.9 Jul 21 20:10:31.720431 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Auth-Token: gAAAAABi2bFozFOmeFjCWltvy8VhOWCofqDkL3eFiDeXHKMTK5OfgvASsxAtL3iRYEdZZ7pOuKVQA34GMN_bqQ_UDkdmJ9edR5NJ1MVnnwiRBdlInNadgfKnNIDs7Z86jLqiTMWRcpjxhBqQIcTH49W1JEnUteXxWbRKxG7NWslugE8wtbbj48I Jul 21 20:10:31.720431 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Domain-Id: None Jul 21 20:10:31.720431 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Domain-Name: None Jul 21 20:10:31.720431 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Identity-Status: Confirmed Jul 21 20:10:31.720431 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Is-Admin-Project: True Jul 21 20:10:31.720431 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Id: default Jul 21 20:10:31.720431 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Name: Default Jul 21 20:10:31.720431 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Id: 6d4acf1287ad4dac9bbf6dc27f427a7c Jul 21 20:10:31.720431 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1971750390 Jul 21 20:10:31.720431 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Role: reader,member Jul 21 20:10:31.720431 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Roles: reader,member Jul 21 20:10:31.722533 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/6d4acf1287ad4dac9bbf6dc27f427a7c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6d4acf1287ad4dac9bbf6dc27f427a7c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_6d4acf1287ad4dac9bbf6dc27f427a7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6d4acf1287ad4dac9bbf6dc27f427a7c"}]}] Jul 21 20:10:31.722533 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1971750390 Jul 21 20:10:31.722533 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Tenant-Id: 6d4acf1287ad4dac9bbf6dc27f427a7c Jul 21 20:10:31.722533 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1971750390 Jul 21 20:10:31.722533 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User: tempest-ServerRescueNegativeTestJSON-1971750390-project Jul 21 20:10:31.722533 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Id: default Jul 21 20:10:31.722533 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Name: Default Jul 21 20:10:31.722533 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Id: df9139f72d004b2fac1cba17647c129d Jul 21 20:10:31.722533 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1971750390-project Jul 21 20:10:31.722533 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: method: > Jul 21 20:10:31.722533 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: exception: Cannot 'detach_volume' instance 5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6 while it is in vm_state rescued Jul 21 20:10:31.723304 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: action_args: {'server_id': '5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6', 'id': '400c7887-41b9-42a0-9afe-6c254423acb6'} Jul 21 20:10:31.723304 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 20:10:31.723304 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:10:31.723304 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 21 20:10:31.723304 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 21 20:10:31.723304 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 21 20:10:31.723304 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 21 20:10:31.723304 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 21 20:10:31.723304 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 21 20:10:31.723304 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 21 20:10:31.723304 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:10:31.723304 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:10:31.723304 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:10:31.723304 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:10:31.723304 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:10:31.723304 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:10:31.723304 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 20:10:31.723304 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 20:10:31.723304 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 20:10:31.723304 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 20:10:31.724560 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 21 20:10:31.724560 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 21 20:10:31.724560 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 21 20:10:31.724560 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 21 20:10:31.724560 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6 while it is in vm_state rescued Jul 21 20:10:31.724560 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:10:31.724560 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:10:31.724560 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:10:31.724560 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:10:31.724560 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:10:31.724560 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:10:31.724560 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 20:10:31.724560 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 20:10:31.724560 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6 while it is in vm_state rescued Jul 21 20:10:31.724560 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:10:31.724560 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-636bfd4a-5ca4-4af9-8651-799867e9234f tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Returning 409 to user: Cannot 'detach_volume' instance 5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6 while it is in vm_state rescued {{(pid=118345) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 20:10:31.725527 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-636bfd4a-5ca4-4af9-8651-799867e9234f tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "DELETE /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6/os-volume_attachments/400c7887-41b9-42a0-9afe-6c254423acb6" status: 409 len: 152 microversion: 2.1 time: 0.136147 Jul 21 20:10:31.725527 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 299/576] 10.222.0.58 () {58 vars in 1415 bytes} [Thu Jul 21 20:10:31 2022] DELETE /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6/os-volume_attachments/400c7887-41b9-42a0-9afe-6c254423acb6 => generated 152 bytes in 138 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 21 20:10:31.731203 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-51d08ab4-6af9-410d-ad90-1e62a92d4d1b tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:10:31.731736 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-51d08ab4-6af9-410d-ad90-1e62a92d4d1b tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:10:31.733615 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG dbcounter [-] [118344] Writing DB stats nova_api:SELECT=36 {{(pid=118344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:10:31.738958 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-51d08ab4-6af9-410d-ad90-1e62a92d4d1b tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:31.739410 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-51d08ab4-6af9-410d-ad90-1e62a92d4d1b tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:31.740170 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-51d08ab4-6af9-410d-ad90-1e62a92d4d1b tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:31.740590 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-51d08ab4-6af9-410d-ad90-1e62a92d4d1b tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:31.940843 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-51d08ab4-6af9-410d-ad90-1e62a92d4d1b tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "POST /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6/action" status: 202 len: 0 microversion: 2.1 time: 0.213282 Jul 21 20:10:31.941620 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 278/577] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Jul 21 20:10:31 2022] POST /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6/action => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 20:10:31.950348 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-235b567d-8ac9-421b-8782-fc358fb9c606 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:10:31.950958 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-235b567d-8ac9-421b-8782-fc358fb9c606 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:10:31.957311 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-235b567d-8ac9-421b-8782-fc358fb9c606 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:31.957761 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-235b567d-8ac9-421b-8782-fc358fb9c606 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:31.958527 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-235b567d-8ac9-421b-8782-fc358fb9c606 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:31.958966 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-235b567d-8ac9-421b-8782-fc358fb9c606 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:32.118224 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-235b567d-8ac9-421b-8782-fc358fb9c606 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:10:32.126197 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-235b567d-8ac9-421b-8782-fc358fb9c606 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6" status: 200 len: 1725 microversion: 2.1 time: 0.180393 Jul 21 20:10:32.126803 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 300/578] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:10:31 2022] GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6 => generated 1725 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:10:33.146746 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-c58c7398-50c2-4a87-9aad-344a00d853dc tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:10:33.147475 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-c58c7398-50c2-4a87-9aad-344a00d853dc tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:10:33.153747 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-c58c7398-50c2-4a87-9aad-344a00d853dc tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:33.154190 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-c58c7398-50c2-4a87-9aad-344a00d853dc tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:33.154950 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-c58c7398-50c2-4a87-9aad-344a00d853dc tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:33.155410 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-c58c7398-50c2-4a87-9aad-344a00d853dc tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:33.287010 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-c58c7398-50c2-4a87-9aad-344a00d853dc tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:10:33.294929 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-c58c7398-50c2-4a87-9aad-344a00d853dc tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6" status: 200 len: 1725 microversion: 2.1 time: 0.154544 Jul 21 20:10:33.295528 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 279/579] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:10:33 2022] GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:10:34.313937 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-4f422268-eca9-49d6-b261-34dd82675b70 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:10:34.314531 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-4f422268-eca9-49d6-b261-34dd82675b70 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:10:34.316911 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_api:SELECT=36 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:10:34.321615 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4f422268-eca9-49d6-b261-34dd82675b70 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:34.322059 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4f422268-eca9-49d6-b261-34dd82675b70 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:34.322817 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4f422268-eca9-49d6-b261-34dd82675b70 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:34.323283 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4f422268-eca9-49d6-b261-34dd82675b70 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:34.458899 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-4f422268-eca9-49d6-b261-34dd82675b70 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:10:34.466876 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-4f422268-eca9-49d6-b261-34dd82675b70 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6" status: 200 len: 1725 microversion: 2.1 time: 0.156884 Jul 21 20:10:34.467482 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 301/580] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:10:34 2022] GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:10:35.484184 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-5747372c-71f3-4e4a-9131-2fdd44d26039 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:10:35.485601 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-5747372c-71f3-4e4a-9131-2fdd44d26039 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:10:35.491313 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-5747372c-71f3-4e4a-9131-2fdd44d26039 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:35.491755 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-5747372c-71f3-4e4a-9131-2fdd44d26039 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:35.492512 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-5747372c-71f3-4e4a-9131-2fdd44d26039 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:35.492942 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-5747372c-71f3-4e4a-9131-2fdd44d26039 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:35.625876 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-5747372c-71f3-4e4a-9131-2fdd44d26039 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:10:35.634730 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-5747372c-71f3-4e4a-9131-2fdd44d26039 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6" status: 200 len: 1725 microversion: 2.1 time: 0.154224 Jul 21 20:10:35.635343 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 280/581] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:10:35 2022] GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:10:36.652723 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-842fd069-32c1-45ed-9d71-5e17f52ec1b7 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:10:36.653337 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-842fd069-32c1-45ed-9d71-5e17f52ec1b7 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:10:36.660073 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-842fd069-32c1-45ed-9d71-5e17f52ec1b7 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:36.660522 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-842fd069-32c1-45ed-9d71-5e17f52ec1b7 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:36.661285 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-842fd069-32c1-45ed-9d71-5e17f52ec1b7 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:36.661722 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-842fd069-32c1-45ed-9d71-5e17f52ec1b7 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:36.800711 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-842fd069-32c1-45ed-9d71-5e17f52ec1b7 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:10:36.808577 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-842fd069-32c1-45ed-9d71-5e17f52ec1b7 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6" status: 200 len: 1731 microversion: 2.1 time: 0.159735 Jul 21 20:10:36.809164 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 302/582] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:10:36 2022] GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6 => generated 1731 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:10:36.827688 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-12f2e667-54ec-41ac-80e4-6af43db8fafe tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:10:36.828216 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-12f2e667-54ec-41ac-80e4-6af43db8fafe tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:10:36.836354 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-12f2e667-54ec-41ac-80e4-6af43db8fafe tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:36.837048 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-12f2e667-54ec-41ac-80e4-6af43db8fafe tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:36.837947 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-12f2e667-54ec-41ac-80e4-6af43db8fafe tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:36.838595 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-12f2e667-54ec-41ac-80e4-6af43db8fafe tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:36.920036 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-12f2e667-54ec-41ac-80e4-6af43db8fafe tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096135 Jul 21 20:10:36.920630 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 281/583] 10.222.0.58 () {58 vars in 1274 bytes} [Thu Jul 21 20:10:36 2022] GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:10:37.969183 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [req-754d7e29-3709-43e5-915e-03d7392053cb req-ad9753a2-3ce8-4c7b-8d4f-b0642c30ba99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6", "tag": "2c53b026-bf56-4c64-b42c-bad40f216602"}]} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:10:37.977855 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-754d7e29-3709-43e5-915e-03d7392053cb req-ad9753a2-3ce8-4c7b-8d4f-b0642c30ba99 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:37.978298 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-754d7e29-3709-43e5-915e-03d7392053cb req-ad9753a2-3ce8-4c7b-8d4f-b0642c30ba99 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:37.989298 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.compute.server_external_events [req-754d7e29-3709-43e5-915e-03d7392053cb req-ad9753a2-3ce8-4c7b-8d4f-b0642c30ba99 service nova] Creating event network-changed:2c53b026-bf56-4c64-b42c-bad40f216602 for instance 5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6 on hv-cinder-85054 Jul 21 20:10:37.995351 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [req-754d7e29-3709-43e5-915e-03d7392053cb req-ad9753a2-3ce8-4c7b-8d4f-b0642c30ba99 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091393 Jul 21 20:10:37.995943 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 303/584] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 20:10:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:10:40.010382 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [req-a244d59f-691b-4a8d-9f56-d352e2ae4aad req-da47d004-117d-470f-8e9f-efe7ff44e838 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6", "tag": "2c53b026-bf56-4c64-b42c-bad40f216602"}]} {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:10:40.018334 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [req-a244d59f-691b-4a8d-9f56-d352e2ae4aad req-da47d004-117d-470f-8e9f-efe7ff44e838 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:40.018771 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [req-a244d59f-691b-4a8d-9f56-d352e2ae4aad req-da47d004-117d-470f-8e9f-efe7ff44e838 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:40.029418 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.compute.server_external_events [req-a244d59f-691b-4a8d-9f56-d352e2ae4aad req-da47d004-117d-470f-8e9f-efe7ff44e838 service nova] Creating event network-changed:2c53b026-bf56-4c64-b42c-bad40f216602 for instance 5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6 on hv-cinder-85054 Jul 21 20:10:40.034723 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [req-a244d59f-691b-4a8d-9f56-d352e2ae4aad req-da47d004-117d-470f-8e9f-efe7ff44e838 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028059 Jul 21 20:10:40.035331 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 282/585] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 20:10:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:10:40.359755 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-1d43c498-f824-4fb9-8f62-58803adc27af tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:10:40.360340 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-1d43c498-f824-4fb9-8f62-58803adc27af tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:10:40.366410 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1d43c498-f824-4fb9-8f62-58803adc27af tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:40.366877 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1d43c498-f824-4fb9-8f62-58803adc27af tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:40.367734 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1d43c498-f824-4fb9-8f62-58803adc27af tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:40.368196 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1d43c498-f824-4fb9-8f62-58803adc27af tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:40.456652 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.objects.instance [None req-1d43c498-f824-4fb9-8f62-58803adc27af tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lazy-loading 'services' on Instance uuid 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a {{(pid=118345) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 20:10:40.698661 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-1d43c498-f824-4fb9-8f62-58803adc27af tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "DELETE /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a/os-volume_attachments/f64e6d46-0c9b-4232-b699-521e8130af76" status: 202 len: 0 microversion: 2.1 time: 0.450182 Jul 21 20:10:40.699288 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 304/586] 10.222.0.58 () {58 vars in 1415 bytes} [Thu Jul 21 20:10:40 2022] DELETE /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a/os-volume_attachments/f64e6d46-0c9b-4232-b699-521e8130af76 => generated 0 bytes in 452 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 20:10:42.869807 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-064b8d92-6215-450a-bdab-bfab7e8c91b3 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:10:42.875946 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-064b8d92-6215-450a-bdab-bfab7e8c91b3 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:42.876385 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-064b8d92-6215-450a-bdab-bfab7e8c91b3 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:42.897916 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-064b8d92-6215-450a-bdab-bfab7e8c91b3 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a] Going to try to stop instance {{(pid=118344) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 21 20:10:43.111742 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-064b8d92-6215-450a-bdab-bfab7e8c91b3 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "POST /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a/action" status: 202 len: 0 microversion: 2.1 time: 0.246531 Jul 21 20:10:43.112384 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 283/587] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Jul 21 20:10:42 2022] POST /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a/action => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 21 20:10:43.122034 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-839379c4-e836-4da0-b750-7b40cef48146 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:10:43.124355 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-839379c4-e836-4da0-b750-7b40cef48146 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:10:43.129956 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-839379c4-e836-4da0-b750-7b40cef48146 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:43.130638 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-839379c4-e836-4da0-b750-7b40cef48146 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:43.131971 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-839379c4-e836-4da0-b750-7b40cef48146 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:43.132643 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-839379c4-e836-4da0-b750-7b40cef48146 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:43.270412 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-839379c4-e836-4da0-b750-7b40cef48146 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:10:43.277851 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-839379c4-e836-4da0-b750-7b40cef48146 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a" status: 200 len: 1677 microversion: 2.1 time: 0.160345 Jul 21 20:10:43.278410 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 305/588] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:10:43 2022] GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:10:44.297930 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-a3c7c973-be3e-4ff5-a531-fd74680a773f tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:10:44.298660 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-a3c7c973-be3e-4ff5-a531-fd74680a773f tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:10:44.305396 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-a3c7c973-be3e-4ff5-a531-fd74680a773f tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:44.305849 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-a3c7c973-be3e-4ff5-a531-fd74680a773f tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:44.306605 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-a3c7c973-be3e-4ff5-a531-fd74680a773f tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:44.307057 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-a3c7c973-be3e-4ff5-a531-fd74680a773f tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:44.441682 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-a3c7c973-be3e-4ff5-a531-fd74680a773f tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:10:44.446952 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-a3c7c973-be3e-4ff5-a531-fd74680a773f tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a" status: 200 len: 1677 microversion: 2.1 time: 0.153819 Jul 21 20:10:44.447551 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 284/589] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:10:44 2022] GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:10:45.463848 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-962020f9-b204-4772-9739-484658ea9dcd tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:10:45.464456 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-962020f9-b204-4772-9739-484658ea9dcd tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:10:45.470719 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-962020f9-b204-4772-9739-484658ea9dcd tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:45.471195 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-962020f9-b204-4772-9739-484658ea9dcd tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:45.471966 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-962020f9-b204-4772-9739-484658ea9dcd tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:45.472397 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-962020f9-b204-4772-9739-484658ea9dcd tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:45.599745 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-962020f9-b204-4772-9739-484658ea9dcd tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:10:45.607006 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-962020f9-b204-4772-9739-484658ea9dcd tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a" status: 200 len: 1677 microversion: 2.1 time: 0.147056 Jul 21 20:10:45.607594 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 306/590] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:10:45 2022] GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a => generated 1677 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:10:46.624755 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-dfa6b7eb-f55a-40bc-8902-cf4fca736840 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:10:46.625361 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-dfa6b7eb-f55a-40bc-8902-cf4fca736840 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:10:46.631885 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-dfa6b7eb-f55a-40bc-8902-cf4fca736840 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:46.632326 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-dfa6b7eb-f55a-40bc-8902-cf4fca736840 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:46.633084 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-dfa6b7eb-f55a-40bc-8902-cf4fca736840 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:46.633513 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-dfa6b7eb-f55a-40bc-8902-cf4fca736840 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:46.760653 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-dfa6b7eb-f55a-40bc-8902-cf4fca736840 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:10:46.768079 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-dfa6b7eb-f55a-40bc-8902-cf4fca736840 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a" status: 200 len: 1677 microversion: 2.1 time: 0.147323 Jul 21 20:10:46.768646 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 285/591] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:10:46 2022] GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a => generated 1677 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:10:47.786130 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-ad86ce8d-631f-40a2-84a2-9dc161e7d3f6 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:10:47.786737 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-ad86ce8d-631f-40a2-84a2-9dc161e7d3f6 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:10:47.794311 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ad86ce8d-631f-40a2-84a2-9dc161e7d3f6 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:47.794758 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ad86ce8d-631f-40a2-84a2-9dc161e7d3f6 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:47.795554 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ad86ce8d-631f-40a2-84a2-9dc161e7d3f6 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:47.795986 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ad86ce8d-631f-40a2-84a2-9dc161e7d3f6 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:47.921807 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-ad86ce8d-631f-40a2-84a2-9dc161e7d3f6 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:10:47.929778 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-ad86ce8d-631f-40a2-84a2-9dc161e7d3f6 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a" status: 200 len: 1677 microversion: 2.1 time: 0.147592 Jul 21 20:10:47.930348 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 307/592] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:10:47 2022] GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a => generated 1677 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:10:48.947785 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-b1f938fc-a952-4189-8cca-fed42e9e36bc tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:10:48.948392 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-b1f938fc-a952-4189-8cca-fed42e9e36bc tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:10:48.954906 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-b1f938fc-a952-4189-8cca-fed42e9e36bc tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:48.955382 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-b1f938fc-a952-4189-8cca-fed42e9e36bc tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:48.956142 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-b1f938fc-a952-4189-8cca-fed42e9e36bc tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:48.956575 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-b1f938fc-a952-4189-8cca-fed42e9e36bc tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:49.081805 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-b1f938fc-a952-4189-8cca-fed42e9e36bc tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:10:49.089149 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-b1f938fc-a952-4189-8cca-fed42e9e36bc tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a" status: 200 len: 1677 microversion: 2.1 time: 0.145230 Jul 21 20:10:49.089717 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 286/593] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:10:48 2022] GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a => generated 1677 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:10:50.106859 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-26337046-fd26-42da-af13-39691c06f607 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:10:50.107489 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-26337046-fd26-42da-af13-39691c06f607 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:10:50.113496 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-26337046-fd26-42da-af13-39691c06f607 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:50.113945 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-26337046-fd26-42da-af13-39691c06f607 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:50.114702 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-26337046-fd26-42da-af13-39691c06f607 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:50.115176 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-26337046-fd26-42da-af13-39691c06f607 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:50.250811 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-26337046-fd26-42da-af13-39691c06f607 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:10:50.258285 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-26337046-fd26-42da-af13-39691c06f607 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a" status: 200 len: 1677 microversion: 2.1 time: 0.155285 Jul 21 20:10:50.258846 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 308/594] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:10:50 2022] GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:10:51.275231 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-08ef96fa-62c0-4784-a35b-91115a0b1b8e tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:10:51.275889 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-08ef96fa-62c0-4784-a35b-91115a0b1b8e tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:10:51.282309 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-08ef96fa-62c0-4784-a35b-91115a0b1b8e tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:51.282754 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-08ef96fa-62c0-4784-a35b-91115a0b1b8e tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:51.283563 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-08ef96fa-62c0-4784-a35b-91115a0b1b8e tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:51.284001 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-08ef96fa-62c0-4784-a35b-91115a0b1b8e tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:51.414186 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-08ef96fa-62c0-4784-a35b-91115a0b1b8e tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:10:51.421580 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-08ef96fa-62c0-4784-a35b-91115a0b1b8e tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a" status: 200 len: 1677 microversion: 2.1 time: 0.150375 Jul 21 20:10:51.422149 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 287/595] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:10:51 2022] GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:10:52.439248 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-c929c6b4-6254-41e7-a983-e61b624948c0 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:10:52.439949 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-c929c6b4-6254-41e7-a983-e61b624948c0 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:10:52.446135 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c929c6b4-6254-41e7-a983-e61b624948c0 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:52.446570 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c929c6b4-6254-41e7-a983-e61b624948c0 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:52.447363 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c929c6b4-6254-41e7-a983-e61b624948c0 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:52.447796 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c929c6b4-6254-41e7-a983-e61b624948c0 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:52.651360 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-c929c6b4-6254-41e7-a983-e61b624948c0 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:10:52.658833 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-c929c6b4-6254-41e7-a983-e61b624948c0 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a" status: 200 len: 1677 microversion: 2.1 time: 0.223533 Jul 21 20:10:52.660070 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 309/596] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:10:52 2022] GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a => generated 1677 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:10:53.677098 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-7f7de37a-4e4c-497a-8773-edf9231c8419 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:10:53.677705 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-7f7de37a-4e4c-497a-8773-edf9231c8419 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:10:53.684191 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-7f7de37a-4e4c-497a-8773-edf9231c8419 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:53.684632 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-7f7de37a-4e4c-497a-8773-edf9231c8419 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:53.685389 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-7f7de37a-4e4c-497a-8773-edf9231c8419 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:53.685821 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-7f7de37a-4e4c-497a-8773-edf9231c8419 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:53.814682 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-7f7de37a-4e4c-497a-8773-edf9231c8419 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:10:53.822140 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-7f7de37a-4e4c-497a-8773-edf9231c8419 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a" status: 200 len: 1677 microversion: 2.1 time: 0.149642 Jul 21 20:10:53.822704 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 288/597] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:10:53 2022] GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:10:54.840407 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-4c393f66-881a-45b7-acda-588919a62ddb tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:10:54.840981 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-4c393f66-881a-45b7-acda-588919a62ddb tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:10:54.847245 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4c393f66-881a-45b7-acda-588919a62ddb tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:54.847693 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4c393f66-881a-45b7-acda-588919a62ddb tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:54.848445 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4c393f66-881a-45b7-acda-588919a62ddb tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:54.848879 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4c393f66-881a-45b7-acda-588919a62ddb tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:54.977434 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-4c393f66-881a-45b7-acda-588919a62ddb tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:10:54.984808 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-4c393f66-881a-45b7-acda-588919a62ddb tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a" status: 200 len: 1677 microversion: 2.1 time: 0.148456 Jul 21 20:10:54.985373 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 310/598] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:10:54 2022] GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:10:56.002304 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-ad345951-48fb-4aef-9c23-c703db3dd3f8 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:10:56.003395 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-ad345951-48fb-4aef-9c23-c703db3dd3f8 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:10:56.010012 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-ad345951-48fb-4aef-9c23-c703db3dd3f8 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:56.010458 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-ad345951-48fb-4aef-9c23-c703db3dd3f8 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:56.011267 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-ad345951-48fb-4aef-9c23-c703db3dd3f8 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:56.011703 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-ad345951-48fb-4aef-9c23-c703db3dd3f8 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:56.015690 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG dbcounter [-] [118344] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:10:56.148289 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-ad345951-48fb-4aef-9c23-c703db3dd3f8 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:10:56.155694 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-ad345951-48fb-4aef-9c23-c703db3dd3f8 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a" status: 200 len: 1677 microversion: 2.1 time: 0.157349 Jul 21 20:10:56.157909 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 289/599] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:10:55 2022] GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:10:57.172858 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-caea529e-f0ab-4cc4-a13c-98e2f193c7f8 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:10:57.173468 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-caea529e-f0ab-4cc4-a13c-98e2f193c7f8 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:10:57.180075 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-caea529e-f0ab-4cc4-a13c-98e2f193c7f8 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:57.180521 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-caea529e-f0ab-4cc4-a13c-98e2f193c7f8 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:57.181281 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-caea529e-f0ab-4cc4-a13c-98e2f193c7f8 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:57.181716 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-caea529e-f0ab-4cc4-a13c-98e2f193c7f8 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:57.309372 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-caea529e-f0ab-4cc4-a13c-98e2f193c7f8 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:10:57.316820 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-caea529e-f0ab-4cc4-a13c-98e2f193c7f8 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a" status: 200 len: 1677 microversion: 2.1 time: 0.147904 Jul 21 20:10:57.317386 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 311/600] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:10:57 2022] GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a => generated 1677 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:10:58.334073 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-66dcc225-ce39-4888-8aa8-e8e86d009cf3 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:10:58.334683 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-66dcc225-ce39-4888-8aa8-e8e86d009cf3 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:10:58.341546 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-66dcc225-ce39-4888-8aa8-e8e86d009cf3 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:58.341999 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-66dcc225-ce39-4888-8aa8-e8e86d009cf3 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:58.342793 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-66dcc225-ce39-4888-8aa8-e8e86d009cf3 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:58.343255 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-66dcc225-ce39-4888-8aa8-e8e86d009cf3 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:58.469938 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-66dcc225-ce39-4888-8aa8-e8e86d009cf3 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:10:58.477631 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-66dcc225-ce39-4888-8aa8-e8e86d009cf3 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a" status: 200 len: 1677 microversion: 2.1 time: 0.147824 Jul 21 20:10:58.478198 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 290/601] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:10:58 2022] GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a => generated 1677 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:10:59.495494 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-da5fc902-4af8-4b36-8632-b07609364140 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:10:59.496097 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-da5fc902-4af8-4b36-8632-b07609364140 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:10:59.502184 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-da5fc902-4af8-4b36-8632-b07609364140 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:59.502631 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-da5fc902-4af8-4b36-8632-b07609364140 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:59.503937 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-da5fc902-4af8-4b36-8632-b07609364140 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:59.504407 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-da5fc902-4af8-4b36-8632-b07609364140 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:59.506994 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=1 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:10:59.636376 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-da5fc902-4af8-4b36-8632-b07609364140 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:10:59.644022 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-da5fc902-4af8-4b36-8632-b07609364140 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a" status: 200 len: 1654 microversion: 2.1 time: 0.152409 Jul 21 20:10:59.644655 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 312/602] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:10:59 2022] GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a => generated 1654 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:10:59.660782 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-6b906376-79f3-4de9-9d7d-f8bc17645a69 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:10:59.667384 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-6b906376-79f3-4de9-9d7d-f8bc17645a69 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:59.667827 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-6b906376-79f3-4de9-9d7d-f8bc17645a69 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:59.689570 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-6b906376-79f3-4de9-9d7d-f8bc17645a69 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a] Going to try to start instance {{(pid=118344) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 21 20:10:59.928972 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-6b906376-79f3-4de9-9d7d-f8bc17645a69 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "POST /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a/action" status: 202 len: 0 microversion: 2.1 time: 0.272367 Jul 21 20:10:59.929575 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 291/603] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Jul 21 20:10:59 2022] POST /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a/action => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 20:10:59.937727 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-d0566aba-bb5e-4939-b66c-e54550c99c64 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:10:59.942111 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-d0566aba-bb5e-4939-b66c-e54550c99c64 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:10:59.945174 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d0566aba-bb5e-4939-b66c-e54550c99c64 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:59.945622 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d0566aba-bb5e-4939-b66c-e54550c99c64 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:10:59.946409 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d0566aba-bb5e-4939-b66c-e54550c99c64 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:10:59.946839 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d0566aba-bb5e-4939-b66c-e54550c99c64 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:00.077848 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-d0566aba-bb5e-4939-b66c-e54550c99c64 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:00.085458 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-d0566aba-bb5e-4939-b66c-e54550c99c64 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a" status: 200 len: 1663 microversion: 2.1 time: 0.151634 Jul 21 20:11:00.086152 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 313/604] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:10:59 2022] GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a => generated 1663 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:11:01.104639 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-8689f1b0-29e7-4f77-972b-0d1693d24dca tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:01.105340 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-8689f1b0-29e7-4f77-972b-0d1693d24dca tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:01.111552 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-8689f1b0-29e7-4f77-972b-0d1693d24dca tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:01.112002 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-8689f1b0-29e7-4f77-972b-0d1693d24dca tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:01.113370 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-8689f1b0-29e7-4f77-972b-0d1693d24dca tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:01.113805 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-8689f1b0-29e7-4f77-972b-0d1693d24dca tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:01.190787 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-db3feffc-3d83-4722-a607-0b6b99b9a4fd tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:01.191333 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-db3feffc-3d83-4722-a607-0b6b99b9a4fd tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 1c38827c-8adc-4201-ae50-94e43ffbb63a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:01.197572 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-db3feffc-3d83-4722-a607-0b6b99b9a4fd tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:01.203744 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-db3feffc-3d83-4722-a607-0b6b99b9a4fd tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:01.203744 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-db3feffc-3d83-4722-a607-0b6b99b9a4fd tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:01.203744 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-db3feffc-3d83-4722-a607-0b6b99b9a4fd tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:01.223491 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-db3feffc-3d83-4722-a607-0b6b99b9a4fd tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/1c38827c-8adc-4201-ae50-94e43ffbb63a/ips" status: 200 len: 150 microversion: 2.1 time: 0.088364 Jul 21 20:11:01.224051 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 314/605] 10.222.0.58 () {58 vars in 1247 bytes} [Thu Jul 21 20:11:01 2022] GET /compute/v2.1/servers/1c38827c-8adc-4201-ae50-94e43ffbb63a/ips => generated 150 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 20:11:01.236940 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-885cf976-9290-4e55-8627-31470a4cabe9 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "709026d0-85e3-4b94-9db6-a81ba9611c17"}} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:11:01.238761 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-885cf976-9290-4e55-8627-31470a4cabe9 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 1c38827c-8adc-4201-ae50-94e43ffbb63a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:01.244615 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-885cf976-9290-4e55-8627-31470a4cabe9 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:01.245242 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-885cf976-9290-4e55-8627-31470a4cabe9 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:01.246002 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-885cf976-9290-4e55-8627-31470a4cabe9 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:01.246456 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-885cf976-9290-4e55-8627-31470a4cabe9 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:01.249131 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-8689f1b0-29e7-4f77-972b-0d1693d24dca tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:01.256869 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-8689f1b0-29e7-4f77-972b-0d1693d24dca tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a" status: 200 len: 1663 microversion: 2.1 time: 0.156933 Jul 21 20:11:01.257440 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 292/606] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:11:01 2022] GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a => generated 1663 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:11:01.325365 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.wsgi [None req-885cf976-9290-4e55-8627-31470a4cabe9 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] HTTP exception thrown: Invalid volume: volume 709026d0-85e3-4b94-9db6-a81ba9611c17 is already attached to instances: 8f00566b-862b-4171-9259-b12aaa7ea030 Jul 21 20:11:01.327218 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-885cf976-9290-4e55-8627-31470a4cabe9 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Request method failure captured: Jul 21 20:11:01.327218 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: request: POST /compute/v2.1/servers/1c38827c-8adc-4201-ae50-94e43ffbb63a/os-volume_attachments HTTP/1.1 Jul 21 20:11:01.327218 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Accept: application/json Jul 21 20:11:01.327218 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Accept-Encoding: identity Jul 21 20:11:01.327218 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Connection: close Jul 21 20:11:01.327218 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Content-Length: 74 Jul 21 20:11:01.327218 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Content-Type: application/json Jul 21 20:11:01.327218 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Host: 10.222.0.58 Jul 21 20:11:01.327218 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Openstack-System-Scope: None Jul 21 20:11:01.327218 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: User-Agent: python-urllib3/1.26.9 Jul 21 20:11:01.327218 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Auth-Token: gAAAAABi2bFjKCUxQrNdZsEJV1kBJFiLgTT1Ekl7oj8yg_h_7YxyA7duEHuPdhQkp4Jd1ksQT4I6f50cht2hanCT9gvKpkDXVC1Uog_MnmqMteApPkGCv4CO2lrQc2eP7fSnvkh1csaG9QP2Dj0psWvWObuaYy8zQZsTJEhGK2eg_fgoqVDBHDI Jul 21 20:11:01.327218 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Domain-Id: None Jul 21 20:11:01.327218 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Domain-Name: None Jul 21 20:11:01.327218 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Identity-Status: Confirmed Jul 21 20:11:01.327218 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Is-Admin-Project: True Jul 21 20:11:01.327218 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Id: default Jul 21 20:11:01.327218 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Name: Default Jul 21 20:11:01.327218 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Id: e0075f5ba84547c782504d23f6029fd2 Jul 21 20:11:01.327218 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Name: tempest-AttachVolumeNegativeTest-1294836183 Jul 21 20:11:01.327218 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Role: reader,member Jul 21 20:11:01.327218 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Roles: reader,member Jul 21 20:11:01.328783 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e0075f5ba84547c782504d23f6029fd2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e0075f5ba84547c782504d23f6029fd2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e0075f5ba84547c782504d23f6029fd2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e0075f5ba84547c782504d23f6029fd2"}]}] Jul 21 20:11:01.328783 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Tenant: tempest-AttachVolumeNegativeTest-1294836183 Jul 21 20:11:01.328783 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Tenant-Id: e0075f5ba84547c782504d23f6029fd2 Jul 21 20:11:01.328783 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1294836183 Jul 21 20:11:01.328783 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User: tempest-AttachVolumeNegativeTest-1294836183-project Jul 21 20:11:01.328783 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Id: default Jul 21 20:11:01.328783 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Name: Default Jul 21 20:11:01.328783 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Id: d04a0e68aea7424181f6c2728cbf7e3f Jul 21 20:11:01.328783 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Name: tempest-AttachVolumeNegativeTest-1294836183-project Jul 21 20:11:01.328783 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Jul 21 20:11:01.328783 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: {"volumeAttachment": {"volumeId": "709026d0-85e3-4b94-9db6-a81ba9611c17"}} Jul 21 20:11:01.328783 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: method: > Jul 21 20:11:01.329663 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: exception: Invalid volume: volume 709026d0-85e3-4b94-9db6-a81ba9611c17 is already attached to instances: 8f00566b-862b-4171-9259-b12aaa7ea030 Jul 21 20:11:01.329663 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: action_args: {'server_id': '1c38827c-8adc-4201-ae50-94e43ffbb63a', 'body': {'volumeAttachment': {'volumeId': '709026d0-85e3-4b94-9db6-a81ba9611c17'}}} Jul 21 20:11:01.329663 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 20:11:01.329663 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:11:01.329663 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 21 20:11:01.329663 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 21 20:11:01.329663 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 21 20:11:01.329663 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 21 20:11:01.329663 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 21 20:11:01.329663 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 21 20:11:01.329663 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 21 20:11:01.329663 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 21 20:11:01.329663 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 21 20:11:01.329663 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 21 20:11:01.329663 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 709026d0-85e3-4b94-9db6-a81ba9611c17 is already attached to instances: 8f00566b-862b-4171-9259-b12aaa7ea030 Jul 21 20:11:01.329663 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:11:01.329663 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:11:01.329663 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:11:01.329663 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:11:01.331376 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:11:01.331376 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:11:01.331376 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 20:11:01.331376 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 20:11:01.331376 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 20:11:01.331376 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 20:11:01.331376 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 21 20:11:01.331376 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 20:11:01.331376 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 21 20:11:01.331376 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 20:11:01.331376 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 21 20:11:01.331376 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 20:11:01.331376 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 21 20:11:01.331376 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 21 20:11:01.331376 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 709026d0-85e3-4b94-9db6-a81ba9611c17 is already attached to instances: 8f00566b-862b-4171-9259-b12aaa7ea030 Jul 21 20:11:01.331376 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:11:01.331376 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:11:01.331376 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:11:01.331376 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:11:01.331376 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:11:01.332591 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:11:01.332591 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 20:11:01.332591 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 20:11:01.332591 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 709026d0-85e3-4b94-9db6-a81ba9611c17 is already attached to instances: 8f00566b-862b-4171-9259-b12aaa7ea030 Jul 21 20:11:01.332591 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:11:01.332591 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-885cf976-9290-4e55-8627-31470a4cabe9 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Returning 400 to user: Invalid volume: volume 709026d0-85e3-4b94-9db6-a81ba9611c17 is already attached to instances: 8f00566b-862b-4171-9259-b12aaa7ea030 {{(pid=118345) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 20:11:01.332591 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-885cf976-9290-4e55-8627-31470a4cabe9 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "POST /compute/v2.1/servers/1c38827c-8adc-4201-ae50-94e43ffbb63a/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.095601 Jul 21 20:11:01.332591 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 315/607] 10.222.0.58 () {60 vars in 1322 bytes} [Thu Jul 21 20:11:01 2022] POST /compute/v2.1/servers/1c38827c-8adc-4201-ae50-94e43ffbb63a/os-volume_attachments => generated 174 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 21 20:11:01.338122 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-f50a9a9f-cb25-47b2-bf74-f2bf186d10ab tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:01.338621 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-f50a9a9f-cb25-47b2-bf74-f2bf186d10ab tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 1c38827c-8adc-4201-ae50-94e43ffbb63a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:01.344711 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f50a9a9f-cb25-47b2-bf74-f2bf186d10ab tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:01.345160 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f50a9a9f-cb25-47b2-bf74-f2bf186d10ab tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:01.346187 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f50a9a9f-cb25-47b2-bf74-f2bf186d10ab tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:01.347376 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f50a9a9f-cb25-47b2-bf74-f2bf186d10ab tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:01.370999 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-f50a9a9f-cb25-47b2-bf74-f2bf186d10ab tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 1c38827c-8adc-4201-ae50-94e43ffbb63a] Going to try to terminate instance {{(pid=118344) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 20:11:01.642175 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-f50a9a9f-cb25-47b2-bf74-f2bf186d10ab tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "DELETE /compute/v2.1/servers/1c38827c-8adc-4201-ae50-94e43ffbb63a" status: 204 len: 0 microversion: 2.1 time: 0.307489 Jul 21 20:11:01.644683 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 293/608] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Jul 21 20:11:01 2022] DELETE /compute/v2.1/servers/1c38827c-8adc-4201-ae50-94e43ffbb63a => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 21 20:11:01.651579 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-58987b53-9730-46c3-9b7e-993362d5ec7e tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:01.652185 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-58987b53-9730-46c3-9b7e-993362d5ec7e tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 1c38827c-8adc-4201-ae50-94e43ffbb63a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:01.659005 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-58987b53-9730-46c3-9b7e-993362d5ec7e tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:01.661915 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-58987b53-9730-46c3-9b7e-993362d5ec7e tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:01.661915 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-58987b53-9730-46c3-9b7e-993362d5ec7e tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:01.661915 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-58987b53-9730-46c3-9b7e-993362d5ec7e tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:01.793449 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-58987b53-9730-46c3-9b7e-993362d5ec7e tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:01.801744 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-58987b53-9730-46c3-9b7e-993362d5ec7e tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/1c38827c-8adc-4201-ae50-94e43ffbb63a" status: 200 len: 1681 microversion: 2.1 time: 0.154316 Jul 21 20:11:01.802365 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 316/609] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:11:01 2022] GET /compute/v2.1/servers/1c38827c-8adc-4201-ae50-94e43ffbb63a => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:11:02.276603 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-5ffaceb7-6e01-426a-896b-57e31aa2dd5c tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:02.277533 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-5ffaceb7-6e01-426a-896b-57e31aa2dd5c tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:02.280683 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG dbcounter [-] [118344] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=118344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:11:02.290734 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-5ffaceb7-6e01-426a-896b-57e31aa2dd5c tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:02.291274 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-5ffaceb7-6e01-426a-896b-57e31aa2dd5c tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:02.296092 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-5ffaceb7-6e01-426a-896b-57e31aa2dd5c tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:02.296092 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-5ffaceb7-6e01-426a-896b-57e31aa2dd5c tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:02.428298 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-5ffaceb7-6e01-426a-896b-57e31aa2dd5c tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:02.435726 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-5ffaceb7-6e01-426a-896b-57e31aa2dd5c tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a" status: 200 len: 1667 microversion: 2.1 time: 0.164642 Jul 21 20:11:02.436294 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 294/610] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:11:02 2022] GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a => generated 1667 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:11:02.821430 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-b91845da-d8e7-423f-858a-5dfc6884e6d9 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:02.821976 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-b91845da-d8e7-423f-858a-5dfc6884e6d9 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 1c38827c-8adc-4201-ae50-94e43ffbb63a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:02.828263 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b91845da-d8e7-423f-858a-5dfc6884e6d9 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:02.828707 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b91845da-d8e7-423f-858a-5dfc6884e6d9 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:02.829461 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b91845da-d8e7-423f-858a-5dfc6884e6d9 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:02.829894 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b91845da-d8e7-423f-858a-5dfc6884e6d9 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:02.960093 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-b91845da-d8e7-423f-858a-5dfc6884e6d9 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:02.967447 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-b91845da-d8e7-423f-858a-5dfc6884e6d9 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/1c38827c-8adc-4201-ae50-94e43ffbb63a" status: 200 len: 1681 microversion: 2.1 time: 0.149995 Jul 21 20:11:02.968010 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 317/611] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:11:02 2022] GET /compute/v2.1/servers/1c38827c-8adc-4201-ae50-94e43ffbb63a => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:11:03.985140 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-236814b4-97fa-42be-8c42-2fd9cbe02a26 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:03.985774 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-236814b4-97fa-42be-8c42-2fd9cbe02a26 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 1c38827c-8adc-4201-ae50-94e43ffbb63a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:03.992773 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-236814b4-97fa-42be-8c42-2fd9cbe02a26 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:03.993213 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-236814b4-97fa-42be-8c42-2fd9cbe02a26 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:03.993964 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-236814b4-97fa-42be-8c42-2fd9cbe02a26 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:03.994389 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-236814b4-97fa-42be-8c42-2fd9cbe02a26 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:04.130189 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-236814b4-97fa-42be-8c42-2fd9cbe02a26 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:04.136041 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-236814b4-97fa-42be-8c42-2fd9cbe02a26 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/1c38827c-8adc-4201-ae50-94e43ffbb63a" status: 200 len: 1681 microversion: 2.1 time: 0.154737 Jul 21 20:11:04.136627 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 295/612] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:11:03 2022] GET /compute/v2.1/servers/1c38827c-8adc-4201-ae50-94e43ffbb63a => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:11:04.933067 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [req-0863f0ed-a708-43cb-ae83-50f7142e15c4 req-d4b0b9af-e98d-439c-858d-509f0c90ae76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c38827c-8adc-4201-ae50-94e43ffbb63a", "name": "network-vif-deleted", "tag": "20e5ee13-031b-47f4-b5fd-b3f29746df8a"}]} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:11:04.940480 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_api:SELECT=34 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:11:04.942510 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-0863f0ed-a708-43cb-ae83-50f7142e15c4 req-d4b0b9af-e98d-439c-858d-509f0c90ae76 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:04.943235 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-0863f0ed-a708-43cb-ae83-50f7142e15c4 req-d4b0b9af-e98d-439c-858d-509f0c90ae76 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:04.954986 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.compute.server_external_events [req-0863f0ed-a708-43cb-ae83-50f7142e15c4 req-d4b0b9af-e98d-439c-858d-509f0c90ae76 service nova] Creating event network-vif-deleted:20e5ee13-031b-47f4-b5fd-b3f29746df8a for instance 1c38827c-8adc-4201-ae50-94e43ffbb63a on hv-cinder-85054 Jul 21 20:11:04.960458 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [req-0863f0ed-a708-43cb-ae83-50f7142e15c4 req-d4b0b9af-e98d-439c-858d-509f0c90ae76 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092532 Jul 21 20:11:04.961088 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 318/613] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 20:11:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:11:05.153933 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-dbbcf4f9-f48f-4883-8a0a-5940800602da tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:05.154581 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-dbbcf4f9-f48f-4883-8a0a-5940800602da tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 1c38827c-8adc-4201-ae50-94e43ffbb63a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:05.162395 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-dbbcf4f9-f48f-4883-8a0a-5940800602da tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:05.166608 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-dbbcf4f9-f48f-4883-8a0a-5940800602da tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:05.166608 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-dbbcf4f9-f48f-4883-8a0a-5940800602da tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:05.166608 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-dbbcf4f9-f48f-4883-8a0a-5940800602da tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:05.232072 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-dbbcf4f9-f48f-4883-8a0a-5940800602da tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:05.241675 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-dbbcf4f9-f48f-4883-8a0a-5940800602da tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/1c38827c-8adc-4201-ae50-94e43ffbb63a" status: 200 len: 1325 microversion: 2.1 time: 0.091950 Jul 21 20:11:05.247135 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 296/614] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:11:05 2022] GET /compute/v2.1/servers/1c38827c-8adc-4201-ae50-94e43ffbb63a => generated 1325 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:11:06.260222 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-cdfe93a5-0d5d-496f-92f6-7de8ba0341f0 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:06.260925 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-cdfe93a5-0d5d-496f-92f6-7de8ba0341f0 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 1c38827c-8adc-4201-ae50-94e43ffbb63a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:06.267738 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-cdfe93a5-0d5d-496f-92f6-7de8ba0341f0 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:06.268185 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-cdfe93a5-0d5d-496f-92f6-7de8ba0341f0 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:06.269610 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-cdfe93a5-0d5d-496f-92f6-7de8ba0341f0 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:06.270045 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-cdfe93a5-0d5d-496f-92f6-7de8ba0341f0 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:06.283587 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.wsgi [None req-cdfe93a5-0d5d-496f-92f6-7de8ba0341f0 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] HTTP exception thrown: Instance 1c38827c-8adc-4201-ae50-94e43ffbb63a could not be found. Jul 21 20:11:06.285257 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-cdfe93a5-0d5d-496f-92f6-7de8ba0341f0 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Request method failure captured: Jul 21 20:11:06.285257 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: request: GET /compute/v2.1/servers/1c38827c-8adc-4201-ae50-94e43ffbb63a HTTP/1.1 Jul 21 20:11:06.285257 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Accept: application/json Jul 21 20:11:06.285257 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Accept-Encoding: identity Jul 21 20:11:06.285257 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Connection: close Jul 21 20:11:06.285257 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Content-Length: 0 Jul 21 20:11:06.285257 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Content-Type: application/json Jul 21 20:11:06.285257 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Host: 10.222.0.58 Jul 21 20:11:06.285257 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Openstack-System-Scope: None Jul 21 20:11:06.285257 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: User-Agent: python-urllib3/1.26.9 Jul 21 20:11:06.285257 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Auth-Token: gAAAAABi2bFjKCUxQrNdZsEJV1kBJFiLgTT1Ekl7oj8yg_h_7YxyA7duEHuPdhQkp4Jd1ksQT4I6f50cht2hanCT9gvKpkDXVC1Uog_MnmqMteApPkGCv4CO2lrQc2eP7fSnvkh1csaG9QP2Dj0psWvWObuaYy8zQZsTJEhGK2eg_fgoqVDBHDI Jul 21 20:11:06.285257 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Domain-Id: None Jul 21 20:11:06.285257 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Domain-Name: None Jul 21 20:11:06.285257 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Identity-Status: Confirmed Jul 21 20:11:06.285257 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Is-Admin-Project: True Jul 21 20:11:06.285257 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Id: default Jul 21 20:11:06.285257 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Name: Default Jul 21 20:11:06.285257 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Id: e0075f5ba84547c782504d23f6029fd2 Jul 21 20:11:06.285257 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Name: tempest-AttachVolumeNegativeTest-1294836183 Jul 21 20:11:06.285257 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Role: reader,member Jul 21 20:11:06.285257 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Roles: reader,member Jul 21 20:11:06.286603 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e0075f5ba84547c782504d23f6029fd2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e0075f5ba84547c782504d23f6029fd2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e0075f5ba84547c782504d23f6029fd2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e0075f5ba84547c782504d23f6029fd2"}]}] Jul 21 20:11:06.286603 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Tenant: tempest-AttachVolumeNegativeTest-1294836183 Jul 21 20:11:06.286603 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Tenant-Id: e0075f5ba84547c782504d23f6029fd2 Jul 21 20:11:06.286603 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1294836183 Jul 21 20:11:06.286603 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User: tempest-AttachVolumeNegativeTest-1294836183-project Jul 21 20:11:06.286603 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Id: default Jul 21 20:11:06.286603 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Name: Default Jul 21 20:11:06.286603 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Id: d04a0e68aea7424181f6c2728cbf7e3f Jul 21 20:11:06.286603 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Name: tempest-AttachVolumeNegativeTest-1294836183-project Jul 21 20:11:06.286603 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: method: > Jul 21 20:11:06.286603 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: exception: Instance 1c38827c-8adc-4201-ae50-94e43ffbb63a could not be found. Jul 21 20:11:06.286603 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: action_args: {'id': '1c38827c-8adc-4201-ae50-94e43ffbb63a'} Jul 21 20:11:06.287394 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 20:11:06.287394 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:11:06.287394 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 20:11:06.287394 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 20:11:06.287394 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 20:11:06.287394 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 20:11:06.287394 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 20:11:06.287394 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 20:11:06.287394 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 20:11:06.287394 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 20:11:06.287394 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c38827c-8adc-4201-ae50-94e43ffbb63a could not be found. Jul 21 20:11:06.287394 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:11:06.287394 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:11:06.287394 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:11:06.287394 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:11:06.287394 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:11:06.287394 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:11:06.287394 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 20:11:06.287394 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 20:11:06.287394 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 20:11:06.288515 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 20:11:06.288515 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 20:11:06.288515 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 20:11:06.288515 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 20:11:06.288515 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 20:11:06.288515 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 20:11:06.288515 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 20:11:06.288515 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c38827c-8adc-4201-ae50-94e43ffbb63a could not be found. Jul 21 20:11:06.288515 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:11:06.288515 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:11:06.288515 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:11:06.288515 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:11:06.288515 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:11:06.288515 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:11:06.288515 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 20:11:06.288515 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 20:11:06.288515 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c38827c-8adc-4201-ae50-94e43ffbb63a could not be found. Jul 21 20:11:06.288515 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:11:06.289555 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-cdfe93a5-0d5d-496f-92f6-7de8ba0341f0 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Returning 404 to user: Instance 1c38827c-8adc-4201-ae50-94e43ffbb63a could not be found. {{(pid=118345) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 20:11:06.289555 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-cdfe93a5-0d5d-496f-92f6-7de8ba0341f0 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/1c38827c-8adc-4201-ae50-94e43ffbb63a" status: 404 len: 111 microversion: 2.1 time: 0.030748 Jul 21 20:11:06.289555 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 319/615] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:11:06 2022] GET /compute/v2.1/servers/1c38827c-8adc-4201-ae50-94e43ffbb63a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 20:11:06.295804 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-25fd05a5-70c9-445b-a12a-fa16300976c2 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '.version_select at 0x7f351cd0c310>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:06.435460 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-25fd05a5-70c9-445b-a12a-fa16300976c2 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-26977631" status: 202 len: 0 microversion: 2.1 time: 0.143484 Jul 21 20:11:06.436044 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 297/616] 10.222.0.58 () {58 vars in 1214 bytes} [Thu Jul 21 20:11:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-26977631 => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 20:11:07.315834 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-d62b3af4-51c8-4cf5-bba2-fb146ed4687c tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:07.316331 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-d62b3af4-51c8-4cf5-bba2-fb146ed4687c tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 8f00566b-862b-4171-9259-b12aaa7ea030] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:07.322267 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d62b3af4-51c8-4cf5-bba2-fb146ed4687c tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:07.322714 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d62b3af4-51c8-4cf5-bba2-fb146ed4687c tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:07.323510 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d62b3af4-51c8-4cf5-bba2-fb146ed4687c tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:07.323954 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d62b3af4-51c8-4cf5-bba2-fb146ed4687c tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:07.403120 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.objects.instance [None req-d62b3af4-51c8-4cf5-bba2-fb146ed4687c tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lazy-loading 'services' on Instance uuid 8f00566b-862b-4171-9259-b12aaa7ea030 {{(pid=118345) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 20:11:07.644830 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-d62b3af4-51c8-4cf5-bba2-fb146ed4687c tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "DELETE /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030/os-volume_attachments/709026d0-85e3-4b94-9db6-a81ba9611c17" status: 202 len: 0 microversion: 2.1 time: 0.332779 Jul 21 20:11:07.645411 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 320/617] 10.222.0.58 () {58 vars in 1415 bytes} [Thu Jul 21 20:11:07 2022] DELETE /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030/os-volume_attachments/709026d0-85e3-4b94-9db6-a81ba9611c17 => generated 0 bytes in 334 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 20:11:07.653819 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-06cd3d83-578a-413a-9c38-186265b04814 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:07.654743 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-06cd3d83-578a-413a-9c38-186265b04814 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 8f00566b-862b-4171-9259-b12aaa7ea030] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:07.662821 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-06cd3d83-578a-413a-9c38-186265b04814 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:07.663306 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-06cd3d83-578a-413a-9c38-186265b04814 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:07.664078 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-06cd3d83-578a-413a-9c38-186265b04814 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:07.664510 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-06cd3d83-578a-413a-9c38-186265b04814 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:07.693121 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-06cd3d83-578a-413a-9c38-186265b04814 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043186 Jul 21 20:11:07.693596 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 298/618] 10.222.0.58 () {58 vars in 1301 bytes} [Thu Jul 21 20:11:07 2022] GET /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:11:08.705432 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-0bc99ee1-328c-4f8e-8906-756b4aaa7327 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:08.706460 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-0bc99ee1-328c-4f8e-8906-756b4aaa7327 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 8f00566b-862b-4171-9259-b12aaa7ea030] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:08.712526 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0bc99ee1-328c-4f8e-8906-756b4aaa7327 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:08.712961 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0bc99ee1-328c-4f8e-8906-756b4aaa7327 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:08.713711 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0bc99ee1-328c-4f8e-8906-756b4aaa7327 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:08.714134 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0bc99ee1-328c-4f8e-8906-756b4aaa7327 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:08.743900 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-0bc99ee1-328c-4f8e-8906-756b4aaa7327 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042757 Jul 21 20:11:08.744372 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 321/619] 10.222.0.58 () {58 vars in 1301 bytes} [Thu Jul 21 20:11:08 2022] GET /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:11:09.756112 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-350d1943-4a48-43d0-b2ac-13fec49ae0aa tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:09.757044 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-350d1943-4a48-43d0-b2ac-13fec49ae0aa tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 8f00566b-862b-4171-9259-b12aaa7ea030] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:09.763716 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-350d1943-4a48-43d0-b2ac-13fec49ae0aa tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:09.766805 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-350d1943-4a48-43d0-b2ac-13fec49ae0aa tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:09.766805 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-350d1943-4a48-43d0-b2ac-13fec49ae0aa tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:09.766805 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-350d1943-4a48-43d0-b2ac-13fec49ae0aa tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:09.794632 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-350d1943-4a48-43d0-b2ac-13fec49ae0aa tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043139 Jul 21 20:11:09.795225 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 299/620] 10.222.0.58 () {58 vars in 1301 bytes} [Thu Jul 21 20:11:09 2022] GET /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 21 20:11:09.854195 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-0161141b-6798-4e9d-bcad-e1f555189cf9 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:09.854712 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-0161141b-6798-4e9d-bcad-e1f555189cf9 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 8f00566b-862b-4171-9259-b12aaa7ea030] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:09.860764 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0161141b-6798-4e9d-bcad-e1f555189cf9 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:09.861214 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0161141b-6798-4e9d-bcad-e1f555189cf9 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:09.862823 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0161141b-6798-4e9d-bcad-e1f555189cf9 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:09.862940 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0161141b-6798-4e9d-bcad-e1f555189cf9 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:09.887333 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-0161141b-6798-4e9d-bcad-e1f555189cf9 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 8f00566b-862b-4171-9259-b12aaa7ea030] Going to try to terminate instance {{(pid=118345) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 20:11:10.281536 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-0161141b-6798-4e9d-bcad-e1f555189cf9 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "DELETE /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030" status: 204 len: 0 microversion: 2.1 time: 0.433052 Jul 21 20:11:10.282125 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 322/621] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Jul 21 20:11:09 2022] DELETE /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 20:11:10.290771 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-65c6269b-1c36-4f48-af66-dd675d2f97d2 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:10.291534 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-65c6269b-1c36-4f48-af66-dd675d2f97d2 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 8f00566b-862b-4171-9259-b12aaa7ea030] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:10.297763 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-65c6269b-1c36-4f48-af66-dd675d2f97d2 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:10.298206 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-65c6269b-1c36-4f48-af66-dd675d2f97d2 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:10.298969 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-65c6269b-1c36-4f48-af66-dd675d2f97d2 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:10.300060 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-65c6269b-1c36-4f48-af66-dd675d2f97d2 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:10.430227 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-65c6269b-1c36-4f48-af66-dd675d2f97d2 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:10.437859 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-65c6269b-1c36-4f48-af66-dd675d2f97d2 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030" status: 200 len: 1681 microversion: 2.1 time: 0.150994 Jul 21 20:11:10.438410 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 300/622] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:11:10 2022] GET /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030 => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:11:11.455365 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-9c874abb-1446-46d2-99fe-fcb0f8abac59 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:11.456567 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-9c874abb-1446-46d2-99fe-fcb0f8abac59 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 8f00566b-862b-4171-9259-b12aaa7ea030] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:11.462661 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-9c874abb-1446-46d2-99fe-fcb0f8abac59 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:11.463142 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-9c874abb-1446-46d2-99fe-fcb0f8abac59 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:11.464632 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-9c874abb-1446-46d2-99fe-fcb0f8abac59 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:11.465072 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-9c874abb-1446-46d2-99fe-fcb0f8abac59 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:11.702579 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-9c874abb-1446-46d2-99fe-fcb0f8abac59 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:11.714940 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-9c874abb-1446-46d2-99fe-fcb0f8abac59 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030" status: 200 len: 1681 microversion: 2.1 time: 0.259158 Jul 21 20:11:11.714940 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 323/623] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:11:11 2022] GET /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030 => generated 1681 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:11:12.318871 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [req-d430b72c-ea4d-463a-8922-2e1c539eff3f req-210fe98c-0246-44cf-b49c-9ef2b68d76eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f00566b-862b-4171-9259-b12aaa7ea030", "name": "network-vif-deleted", "tag": "41ea78c8-2eb5-49db-9ee7-8b020833e0f8"}]} {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:11:12.334317 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [req-d430b72c-ea4d-463a-8922-2e1c539eff3f req-210fe98c-0246-44cf-b49c-9ef2b68d76eb service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:12.334771 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [req-d430b72c-ea4d-463a-8922-2e1c539eff3f req-210fe98c-0246-44cf-b49c-9ef2b68d76eb service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:12.347236 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.compute.server_external_events [req-d430b72c-ea4d-463a-8922-2e1c539eff3f req-210fe98c-0246-44cf-b49c-9ef2b68d76eb service nova] Creating event network-vif-deleted:41ea78c8-2eb5-49db-9ee7-8b020833e0f8 for instance 8f00566b-862b-4171-9259-b12aaa7ea030 on hv-cinder-85054 Jul 21 20:11:12.352562 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [req-d430b72c-ea4d-463a-8922-2e1c539eff3f req-210fe98c-0246-44cf-b49c-9ef2b68d76eb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037366 Jul 21 20:11:12.353172 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 301/624] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 20:11:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:11:12.726836 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-30151eb0-2667-4b70-898d-79ee9e976980 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:12.727468 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-30151eb0-2667-4b70-898d-79ee9e976980 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 8f00566b-862b-4171-9259-b12aaa7ea030] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:12.733650 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-30151eb0-2667-4b70-898d-79ee9e976980 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:12.736366 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-30151eb0-2667-4b70-898d-79ee9e976980 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:12.736366 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-30151eb0-2667-4b70-898d-79ee9e976980 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:12.736366 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-30151eb0-2667-4b70-898d-79ee9e976980 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:12.766719 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-30151eb0-2667-4b70-898d-79ee9e976980 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:12.767217 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-30151eb0-2667-4b70-898d-79ee9e976980 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:12.769301 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.objects.instance [None req-30151eb0-2667-4b70-898d-79ee9e976980 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lazy-loading 'fault' on Instance uuid 8f00566b-862b-4171-9259-b12aaa7ea030 {{(pid=118345) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 20:11:12.812404 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-30151eb0-2667-4b70-898d-79ee9e976980 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:12.820679 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-30151eb0-2667-4b70-898d-79ee9e976980 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030" status: 200 len: 1331 microversion: 2.1 time: 0.097644 Jul 21 20:11:12.821589 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 324/625] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:11:12 2022] GET /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030 => generated 1331 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:11:13.838944 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-264c617d-3c2e-4d89-a376-bb3ec80020ef tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:13.839597 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-264c617d-3c2e-4d89-a376-bb3ec80020ef tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 8f00566b-862b-4171-9259-b12aaa7ea030] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:13.846277 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-264c617d-3c2e-4d89-a376-bb3ec80020ef tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:13.846718 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-264c617d-3c2e-4d89-a376-bb3ec80020ef tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:13.847495 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-264c617d-3c2e-4d89-a376-bb3ec80020ef tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:13.847924 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-264c617d-3c2e-4d89-a376-bb3ec80020ef tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:13.860916 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.wsgi [None req-264c617d-3c2e-4d89-a376-bb3ec80020ef tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] HTTP exception thrown: Instance 8f00566b-862b-4171-9259-b12aaa7ea030 could not be found. Jul 21 20:11:13.864609 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-264c617d-3c2e-4d89-a376-bb3ec80020ef tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Request method failure captured: Jul 21 20:11:13.864609 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: request: GET /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030 HTTP/1.1 Jul 21 20:11:13.864609 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Accept: application/json Jul 21 20:11:13.864609 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Accept-Encoding: identity Jul 21 20:11:13.864609 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Connection: close Jul 21 20:11:13.864609 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Content-Length: 0 Jul 21 20:11:13.864609 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Content-Type: application/json Jul 21 20:11:13.864609 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Host: 10.222.0.58 Jul 21 20:11:13.864609 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Openstack-System-Scope: None Jul 21 20:11:13.864609 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: User-Agent: python-urllib3/1.26.9 Jul 21 20:11:13.864609 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Auth-Token: gAAAAABi2bFjKCUxQrNdZsEJV1kBJFiLgTT1Ekl7oj8yg_h_7YxyA7duEHuPdhQkp4Jd1ksQT4I6f50cht2hanCT9gvKpkDXVC1Uog_MnmqMteApPkGCv4CO2lrQc2eP7fSnvkh1csaG9QP2Dj0psWvWObuaYy8zQZsTJEhGK2eg_fgoqVDBHDI Jul 21 20:11:13.864609 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Domain-Id: None Jul 21 20:11:13.864609 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Domain-Name: None Jul 21 20:11:13.864609 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Identity-Status: Confirmed Jul 21 20:11:13.864609 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Is-Admin-Project: True Jul 21 20:11:13.864609 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Domain-Id: default Jul 21 20:11:13.864609 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Domain-Name: Default Jul 21 20:11:13.864609 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Id: e0075f5ba84547c782504d23f6029fd2 Jul 21 20:11:13.864609 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Name: tempest-AttachVolumeNegativeTest-1294836183 Jul 21 20:11:13.864609 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Role: reader,member Jul 21 20:11:13.864609 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Roles: reader,member Jul 21 20:11:13.866083 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e0075f5ba84547c782504d23f6029fd2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e0075f5ba84547c782504d23f6029fd2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e0075f5ba84547c782504d23f6029fd2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e0075f5ba84547c782504d23f6029fd2"}]}] Jul 21 20:11:13.866083 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Tenant: tempest-AttachVolumeNegativeTest-1294836183 Jul 21 20:11:13.866083 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Tenant-Id: e0075f5ba84547c782504d23f6029fd2 Jul 21 20:11:13.866083 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1294836183 Jul 21 20:11:13.866083 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User: tempest-AttachVolumeNegativeTest-1294836183-project Jul 21 20:11:13.866083 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Domain-Id: default Jul 21 20:11:13.866083 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Domain-Name: Default Jul 21 20:11:13.866083 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Id: d04a0e68aea7424181f6c2728cbf7e3f Jul 21 20:11:13.866083 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Name: tempest-AttachVolumeNegativeTest-1294836183-project Jul 21 20:11:13.866083 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: method: > Jul 21 20:11:13.866083 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: exception: Instance 8f00566b-862b-4171-9259-b12aaa7ea030 could not be found. Jul 21 20:11:13.866083 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: action_args: {'id': '8f00566b-862b-4171-9259-b12aaa7ea030'} Jul 21 20:11:13.866893 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 20:11:13.866893 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:11:13.866893 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 20:11:13.866893 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 20:11:13.866893 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 20:11:13.866893 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 20:11:13.866893 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 20:11:13.866893 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 20:11:13.866893 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 20:11:13.866893 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 20:11:13.866893 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f00566b-862b-4171-9259-b12aaa7ea030 could not be found. Jul 21 20:11:13.866893 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:11:13.866893 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:11:13.866893 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:11:13.866893 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:11:13.866893 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:11:13.866893 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:11:13.866893 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 20:11:13.866893 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 20:11:13.866893 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 20:11:13.868313 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 20:11:13.868313 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 20:11:13.868313 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 20:11:13.868313 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 20:11:13.868313 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 20:11:13.868313 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 20:11:13.868313 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 20:11:13.868313 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f00566b-862b-4171-9259-b12aaa7ea030 could not be found. Jul 21 20:11:13.868313 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:11:13.868313 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:11:13.868313 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:11:13.868313 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:11:13.868313 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:11:13.868313 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:11:13.868313 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 20:11:13.868313 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 20:11:13.868313 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f00566b-862b-4171-9259-b12aaa7ea030 could not be found. Jul 21 20:11:13.868313 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:11:13.869540 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-264c617d-3c2e-4d89-a376-bb3ec80020ef tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Returning 404 to user: Instance 8f00566b-862b-4171-9259-b12aaa7ea030 could not be found. {{(pid=118344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 20:11:13.869540 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-264c617d-3c2e-4d89-a376-bb3ec80020ef tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030" status: 404 len: 111 microversion: 2.1 time: 0.031960 Jul 21 20:11:13.869540 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 302/626] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:11:13 2022] GET /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 20:11:13.874796 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-768b45ac-f101-4054-a953-e67be11f690f tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '.version_select at 0x7f351cdf7e50>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:13.878645 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR oslo.messaging._drivers.impl_rabbit [None req-768b45ac-f101-4054-a953-e67be11f690f tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [08cd2d4c-c48c-42cc-b92d-9650e32dd96c] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 21 20:11:14.885400 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO oslo.messaging._drivers.impl_rabbit [None req-768b45ac-f101-4054-a953-e67be11f690f tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [08cd2d4c-c48c-42cc-b92d-9650e32dd96c] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 37464. Jul 21 20:11:14.960157 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-768b45ac-f101-4054-a953-e67be11f690f tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2054628863" status: 202 len: 0 microversion: 2.1 time: 1.089066 Jul 21 20:11:14.960730 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 325/627] 10.222.0.58 () {58 vars in 1220 bytes} [Thu Jul 21 20:11:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2054628863 => generated 0 bytes in 1090 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 20:11:15.745989 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-ffc51ead-2ecd-4bab-a4be-e168f1ce51bb tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Action: 'create', calling method: .version_select at 0x7f351cce3430>, body: {"keypair": {"name": "tempest-keypair-200791007", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGBR4gKVI1nr8XA0mYhea7b3LoYcDj1G1IV4RbcaQNQ1zwNvPOPIfPxoGDORcPwPeTzEDzEPVY2gnPXOK76S1c+k9pWkAPj+cKcxMf+lWGjMVyXlAoiV4dQxhdfS6ERZmg=="}} {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:11:15.763578 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.quota [None req-ffc51ead-2ecd-4bab-a4be-e168f1ce51bb tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Getting quotas for project e0075f5ba84547c782504d23f6029fd2. Resources: {'key_pairs'} {{(pid=118344) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 20:11:15.768668 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.quota [None req-ffc51ead-2ecd-4bab-a4be-e168f1ce51bb tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Getting quotas for user d04a0e68aea7424181f6c2728cbf7e3f and project e0075f5ba84547c782504d23f6029fd2. Resources: {'key_pairs'} {{(pid=118344) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 20:11:15.857711 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-ffc51ead-2ecd-4bab-a4be-e168f1ce51bb tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.115678 Jul 21 20:11:15.858312 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 303/628] 10.222.0.58 () {60 vars in 1158 bytes} [Thu Jul 21 20:11:15 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:11:17.045969 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-cd1815a4-4557-4a17-ac91-29595c64cfdd tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:17.046520 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-cd1815a4-4557-4a17-ac91-29595c64cfdd tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:17.052966 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-cd1815a4-4557-4a17-ac91-29595c64cfdd tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:17.053413 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-cd1815a4-4557-4a17-ac91-29595c64cfdd tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:17.054172 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-cd1815a4-4557-4a17-ac91-29595c64cfdd tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:17.054603 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-cd1815a4-4557-4a17-ac91-29595c64cfdd tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:17.083637 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-cd1815a4-4557-4a17-ac91-29595c64cfdd tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f/os-volume_attachments/ba2bdb71-bf73-4a51-b56a-7c36579882f8" status: 200 len: 194 microversion: 2.20 time: 0.041493 Jul 21 20:11:17.083942 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 326/629] 10.222.0.58 () {60 vars in 1453 bytes} [Thu Jul 21 20:11:17 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f/os-volume_attachments/ba2bdb71-bf73-4a51-b56a-7c36579882f8 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 20:11:17.147248 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-734fee6e-d1f2-4360-a1cb-7c17d3a63beb tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:17.147798 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-734fee6e-d1f2-4360-a1cb-7c17d3a63beb tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:17.154429 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-734fee6e-d1f2-4360-a1cb-7c17d3a63beb tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:17.154881 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-734fee6e-d1f2-4360-a1cb-7c17d3a63beb tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:17.155738 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-734fee6e-d1f2-4360-a1cb-7c17d3a63beb tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:17.156123 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-734fee6e-d1f2-4360-a1cb-7c17d3a63beb tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:17.282039 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.objects.instance [None req-734fee6e-d1f2-4360-a1cb-7c17d3a63beb tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lazy-loading 'services' on Instance uuid b07e385b-3d8f-4370-a8fc-013a1c785c0f {{(pid=118344) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 20:11:17.543924 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-734fee6e-d1f2-4360-a1cb-7c17d3a63beb tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f/os-volume_attachments/ba2bdb71-bf73-4a51-b56a-7c36579882f8" status: 202 len: 0 microversion: 2.20 time: 0.401148 Jul 21 20:11:17.544745 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 304/630] 10.222.0.58 () {60 vars in 1456 bytes} [Thu Jul 21 20:11:17 2022] DELETE /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f/os-volume_attachments/ba2bdb71-bf73-4a51-b56a-7c36579882f8 => generated 0 bytes in 403 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 21 20:11:17.553986 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-333d7d6e-9131-4359-bb0c-4a0812564aec tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:17.554908 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-333d7d6e-9131-4359-bb0c-4a0812564aec tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:17.560917 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-333d7d6e-9131-4359-bb0c-4a0812564aec tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:17.561349 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-333d7d6e-9131-4359-bb0c-4a0812564aec tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:17.562125 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-333d7d6e-9131-4359-bb0c-4a0812564aec tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:17.562561 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-333d7d6e-9131-4359-bb0c-4a0812564aec tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:17.590894 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-333d7d6e-9131-4359-bb0c-4a0812564aec tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041662 Jul 21 20:11:17.591492 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 327/631] 10.222.0.58 () {60 vars in 1342 bytes} [Thu Jul 21 20:11:17 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 20:11:18.117338 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-58cb68fe-2946-4bdc-86a8-562593b5d113 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1407861089", "imageRef": "357a1479-6cbd-4882-8d3f-d945fa40e6df", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8c189c91-a136-44cc-8a4c-a42d0a4465fc"}], "security_groups": [{"name": "tempest-securitygroup--1516034457"}], "key_name": "tempest-keypair-200791007", "user_data": "}} {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:11:18.217090 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.network.neutron [None req-58cb68fe-2946-4bdc-86a8-562593b5d113 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] validate_networks() for [('8c189c91-a136-44cc-8a4c-a42d0a4465fc', None, None, None, None, None)] {{(pid=118344) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 20:11:18.602901 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-930e442b-c5e5-48cd-ad16-99d757fa13db tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:18.603860 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-930e442b-c5e5-48cd-ad16-99d757fa13db tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:18.609691 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-930e442b-c5e5-48cd-ad16-99d757fa13db tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:18.610173 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-930e442b-c5e5-48cd-ad16-99d757fa13db tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:18.610936 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-930e442b-c5e5-48cd-ad16-99d757fa13db tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:18.611557 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-930e442b-c5e5-48cd-ad16-99d757fa13db tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:18.633245 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.virt.hardware [None req-58cb68fe-2946-4bdc-86a8-562593b5d113 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Flavor limits 0:0:0 {{(pid=118344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 20:11:18.634079 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.virt.hardware [None req-58cb68fe-2946-4bdc-86a8-562593b5d113 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Image limits 0:0:0 {{(pid=118344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 20:11:18.634751 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.virt.hardware [None req-58cb68fe-2946-4bdc-86a8-562593b5d113 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Flavor pref 0:0:0 {{(pid=118344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 20:11:18.635190 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.virt.hardware [None req-58cb68fe-2946-4bdc-86a8-562593b5d113 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Image pref 0:0:0 {{(pid=118344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 20:11:18.635603 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.virt.hardware [None req-58cb68fe-2946-4bdc-86a8-562593b5d113 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 20:11:18.640335 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:11:18.645553 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-930e442b-c5e5-48cd-ad16-99d757fa13db tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046691 Jul 21 20:11:18.654805 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 328/632] 10.222.0.58 () {60 vars in 1342 bytes} [Thu Jul 21 20:11:18 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 20:11:18.654927 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-58cb68fe-2946-4bdc-86a8-562593b5d113 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:18.654927 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-58cb68fe-2946-4bdc-86a8-562593b5d113 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:18.654927 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-58cb68fe-2946-4bdc-86a8-562593b5d113 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:18.654927 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-58cb68fe-2946-4bdc-86a8-562593b5d113 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:18.669492 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.quota [None req-58cb68fe-2946-4bdc-86a8-562593b5d113 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Getting quotas for project e0075f5ba84547c782504d23f6029fd2. Resources: {'instances', 'cores', 'ram'} {{(pid=118344) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 20:11:18.673460 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.quota [None req-58cb68fe-2946-4bdc-86a8-562593b5d113 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Getting quotas for user d04a0e68aea7424181f6c2728cbf7e3f and project e0075f5ba84547c782504d23f6029fd2. Resources: {'instances', 'cores', 'ram'} {{(pid=118344) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 20:11:18.684741 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-58cb68fe-2946-4bdc-86a8-562593b5d113 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Going to run 1 instances... {{(pid=118344) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 20:11:18.687161 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-58cb68fe-2946-4bdc-86a8-562593b5d113 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: a41559e0-1fb6-44ef-97c1-36025e52fc48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='357a1479-6cbd-4882-8d3f-d945fa40e6df',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118344) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 20:11:18.883709 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-58cb68fe-2946-4bdc-86a8-562593b5d113 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.770953 Jul 21 20:11:18.884351 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 305/633] 10.222.0.58 () {60 vars in 1146 bytes} [Thu Jul 21 20:11:18 2022] POST /compute/v2.1/servers => generated 402 bytes in 772 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 20:11:18.894714 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-07d179a9-561a-4d0d-80f9-82188d8ed75d tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:18.895335 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-07d179a9-561a-4d0d-80f9-82188d8ed75d tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: a41559e0-1fb6-44ef-97c1-36025e52fc48] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:18.949662 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-07d179a9-561a-4d0d-80f9-82188d8ed75d tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:18.956490 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-07d179a9-561a-4d0d-80f9-82188d8ed75d tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/a41559e0-1fb6-44ef-97c1-36025e52fc48" status: 200 len: 1241 microversion: 2.1 time: 0.066039 Jul 21 20:11:18.957054 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 329/634] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:11:18 2022] GET /compute/v2.1/servers/a41559e0-1fb6-44ef-97c1-36025e52fc48 => generated 1241 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:11:19.657758 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-5bead0fe-1161-447b-a750-cbfcf303fb53 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:19.658733 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-5bead0fe-1161-447b-a750-cbfcf303fb53 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:19.665904 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-5bead0fe-1161-447b-a750-cbfcf303fb53 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:19.666344 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-5bead0fe-1161-447b-a750-cbfcf303fb53 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:19.667139 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-5bead0fe-1161-447b-a750-cbfcf303fb53 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:19.667567 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-5bead0fe-1161-447b-a750-cbfcf303fb53 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:19.681203 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG dbcounter [-] [118344] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=118344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:11:19.696489 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-5bead0fe-1161-447b-a750-cbfcf303fb53 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043258 Jul 21 20:11:19.697032 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 306/635] 10.222.0.58 () {60 vars in 1342 bytes} [Thu Jul 21 20:11:19 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:11:19.753611 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-78f4f1a0-32bf-48ea-86af-f0cfe3e7ae7b tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:19.754096 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-78f4f1a0-32bf-48ea-86af-f0cfe3e7ae7b tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:19.760716 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-78f4f1a0-32bf-48ea-86af-f0cfe3e7ae7b tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:19.761150 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-78f4f1a0-32bf-48ea-86af-f0cfe3e7ae7b tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:19.761896 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-78f4f1a0-32bf-48ea-86af-f0cfe3e7ae7b tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:19.762322 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-78f4f1a0-32bf-48ea-86af-f0cfe3e7ae7b tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:19.787290 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-78f4f1a0-32bf-48ea-86af-f0cfe3e7ae7b tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Going to try to terminate instance {{(pid=118345) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 20:11:19.974555 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-62f05631-469e-4cb4-b3d9-2c1fd8470a3d tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:19.975211 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-62f05631-469e-4cb4-b3d9-2c1fd8470a3d tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: a41559e0-1fb6-44ef-97c1-36025e52fc48] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:20.032798 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-62f05631-469e-4cb4-b3d9-2c1fd8470a3d tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:20.038428 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-62f05631-469e-4cb4-b3d9-2c1fd8470a3d tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/a41559e0-1fb6-44ef-97c1-36025e52fc48" status: 200 len: 1241 microversion: 2.1 time: 0.068809 Jul 21 20:11:20.039499 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 307/636] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:11:19 2022] GET /compute/v2.1/servers/a41559e0-1fb6-44ef-97c1-36025e52fc48 => generated 1241 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:11:20.144891 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-78f4f1a0-32bf-48ea-86af-f0cfe3e7ae7b tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 204 len: 0 microversion: 2.20 time: 0.394853 Jul 21 20:11:20.145486 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 330/637] 10.222.0.58 () {60 vars in 1279 bytes} [Thu Jul 21 20:11:19 2022] DELETE /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 0 bytes in 396 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 21 20:11:20.154106 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-c2c2a0b6-b2fb-4a83-8c04-69e50d4dea21 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:20.154709 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-c2c2a0b6-b2fb-4a83-8c04-69e50d4dea21 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:20.161778 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-c2c2a0b6-b2fb-4a83-8c04-69e50d4dea21 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:20.162225 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-c2c2a0b6-b2fb-4a83-8c04-69e50d4dea21 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:20.162986 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-c2c2a0b6-b2fb-4a83-8c04-69e50d4dea21 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:20.165767 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-c2c2a0b6-b2fb-4a83-8c04-69e50d4dea21 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:20.295593 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-c2c2a0b6-b2fb-4a83-8c04-69e50d4dea21 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:20.303422 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-c2c2a0b6-b2fb-4a83-8c04-69e50d4dea21 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:20.304932 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-c2c2a0b6-b2fb-4a83-8c04-69e50d4dea21 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:20.306080 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-c2c2a0b6-b2fb-4a83-8c04-69e50d4dea21 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1722 microversion: 2.20 time: 0.156194 Jul 21 20:11:20.306636 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 308/638] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:11:20 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:11:21.056331 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-4325e2b7-6c04-4f1c-acb4-048572c2e2e8 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:21.057028 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-4325e2b7-6c04-4f1c-acb4-048572c2e2e8 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: a41559e0-1fb6-44ef-97c1-36025e52fc48] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:21.109014 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-4325e2b7-6c04-4f1c-acb4-048572c2e2e8 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:21.115994 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-4325e2b7-6c04-4f1c-acb4-048572c2e2e8 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/a41559e0-1fb6-44ef-97c1-36025e52fc48" status: 200 len: 1241 microversion: 2.1 time: 0.063949 Jul 21 20:11:21.116554 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 331/639] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:11:21 2022] GET /compute/v2.1/servers/a41559e0-1fb6-44ef-97c1-36025e52fc48 => generated 1241 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:11:21.324572 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-06c1f3a3-9d4b-4d41-813b-6c4c9eb15e98 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:21.325079 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-06c1f3a3-9d4b-4d41-813b-6c4c9eb15e98 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:21.331638 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-06c1f3a3-9d4b-4d41-813b-6c4c9eb15e98 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:21.332074 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-06c1f3a3-9d4b-4d41-813b-6c4c9eb15e98 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:21.332832 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-06c1f3a3-9d4b-4d41-813b-6c4c9eb15e98 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:21.333256 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-06c1f3a3-9d4b-4d41-813b-6c4c9eb15e98 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:21.468461 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-06c1f3a3-9d4b-4d41-813b-6c4c9eb15e98 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:21.477946 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-06c1f3a3-9d4b-4d41-813b-6c4c9eb15e98 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:21.479496 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-06c1f3a3-9d4b-4d41-813b-6c4c9eb15e98 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:21.480669 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-06c1f3a3-9d4b-4d41-813b-6c4c9eb15e98 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1722 microversion: 2.20 time: 0.160093 Jul 21 20:11:21.481261 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 309/640] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:11:21 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:11:22.132582 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-bd915a64-4e5d-44fa-908d-eddb3b712f59 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:22.133182 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-bd915a64-4e5d-44fa-908d-eddb3b712f59 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: a41559e0-1fb6-44ef-97c1-36025e52fc48] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:22.185516 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-bd915a64-4e5d-44fa-908d-eddb3b712f59 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:22.192357 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-bd915a64-4e5d-44fa-908d-eddb3b712f59 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/a41559e0-1fb6-44ef-97c1-36025e52fc48" status: 200 len: 1241 microversion: 2.1 time: 0.063572 Jul 21 20:11:22.192924 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 332/641] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:11:22 2022] GET /compute/v2.1/servers/a41559e0-1fb6-44ef-97c1-36025e52fc48 => generated 1241 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:11:22.500392 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-75219257-021d-43f8-a043-26d229ff7e51 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:22.500993 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-75219257-021d-43f8-a043-26d229ff7e51 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:22.507513 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-75219257-021d-43f8-a043-26d229ff7e51 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:22.507959 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-75219257-021d-43f8-a043-26d229ff7e51 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:22.508721 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-75219257-021d-43f8-a043-26d229ff7e51 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:22.509155 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-75219257-021d-43f8-a043-26d229ff7e51 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:22.652172 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-75219257-021d-43f8-a043-26d229ff7e51 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:22.661992 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-75219257-021d-43f8-a043-26d229ff7e51 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:22.663660 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-75219257-021d-43f8-a043-26d229ff7e51 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:22.664826 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-75219257-021d-43f8-a043-26d229ff7e51 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1722 microversion: 2.20 time: 0.168432 Jul 21 20:11:22.665665 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 310/642] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:11:22 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:11:23.208886 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-57c17a7d-34c8-4d1b-a9ea-3e1b4621a602 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:23.209496 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-57c17a7d-34c8-4d1b-a9ea-3e1b4621a602 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: a41559e0-1fb6-44ef-97c1-36025e52fc48] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:23.215446 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-57c17a7d-34c8-4d1b-a9ea-3e1b4621a602 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:23.216034 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-57c17a7d-34c8-4d1b-a9ea-3e1b4621a602 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:23.216822 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-57c17a7d-34c8-4d1b-a9ea-3e1b4621a602 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:23.217250 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-57c17a7d-34c8-4d1b-a9ea-3e1b4621a602 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:23.307863 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-57c17a7d-34c8-4d1b-a9ea-3e1b4621a602 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:23.315263 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-57c17a7d-34c8-4d1b-a9ea-3e1b4621a602 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/a41559e0-1fb6-44ef-97c1-36025e52fc48" status: 200 len: 1245 microversion: 2.1 time: 0.110315 Jul 21 20:11:23.316720 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 333/643] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:11:23 2022] GET /compute/v2.1/servers/a41559e0-1fb6-44ef-97c1-36025e52fc48 => generated 1245 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:11:23.417773 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [req-85d38816-c5c3-4d05-a91b-027a24b557bf req-43ce099b-b192-4f16-a271-ded545df7119 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b07e385b-3d8f-4370-a8fc-013a1c785c0f", "name": "network-vif-deleted", "tag": "b6f7db3f-a2e0-4b71-a01c-2b805c7bf070"}]} {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:11:23.426257 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [req-85d38816-c5c3-4d05-a91b-027a24b557bf req-43ce099b-b192-4f16-a271-ded545df7119 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:23.426673 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [req-85d38816-c5c3-4d05-a91b-027a24b557bf req-43ce099b-b192-4f16-a271-ded545df7119 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:23.437538 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.compute.server_external_events [req-85d38816-c5c3-4d05-a91b-027a24b557bf req-43ce099b-b192-4f16-a271-ded545df7119 service nova] Creating event network-vif-deleted:b6f7db3f-a2e0-4b71-a01c-2b805c7bf070 for instance b07e385b-3d8f-4370-a8fc-013a1c785c0f on hv-cinder-85054 Jul 21 20:11:23.442432 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [req-85d38816-c5c3-4d05-a91b-027a24b557bf req-43ce099b-b192-4f16-a271-ded545df7119 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028264 Jul 21 20:11:23.443197 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 311/644] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 20:11:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:11:23.683091 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-1a7d8b80-f283-489b-b937-def9bee7fc1a tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:23.683734 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-1a7d8b80-f283-489b-b937-def9bee7fc1a tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:23.689911 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1a7d8b80-f283-489b-b937-def9bee7fc1a tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:23.690512 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1a7d8b80-f283-489b-b937-def9bee7fc1a tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:23.691630 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1a7d8b80-f283-489b-b937-def9bee7fc1a tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:23.692051 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1a7d8b80-f283-489b-b937-def9bee7fc1a tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:23.755334 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-1a7d8b80-f283-489b-b937-def9bee7fc1a tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:23.764254 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-1a7d8b80-f283-489b-b937-def9bee7fc1a tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:23.765854 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-1a7d8b80-f283-489b-b937-def9bee7fc1a tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:23.767266 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-1a7d8b80-f283-489b-b937-def9bee7fc1a tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 200 len: 1365 microversion: 2.20 time: 0.088243 Jul 21 20:11:23.768599 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 334/645] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:11:23 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 1365 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:11:24.334727 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-f313845a-e51e-4098-915e-f40c0d784aac tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:24.335664 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-f313845a-e51e-4098-915e-f40c0d784aac tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: a41559e0-1fb6-44ef-97c1-36025e52fc48] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:24.342302 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f313845a-e51e-4098-915e-f40c0d784aac tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:24.343485 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f313845a-e51e-4098-915e-f40c0d784aac tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:24.343668 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f313845a-e51e-4098-915e-f40c0d784aac tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:24.344349 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f313845a-e51e-4098-915e-f40c0d784aac tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:24.410926 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-f313845a-e51e-4098-915e-f40c0d784aac tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:24.418656 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-f313845a-e51e-4098-915e-f40c0d784aac tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/a41559e0-1fb6-44ef-97c1-36025e52fc48" status: 200 len: 1245 microversion: 2.1 time: 0.089257 Jul 21 20:11:24.419247 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 312/646] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:11:24 2022] GET /compute/v2.1/servers/a41559e0-1fb6-44ef-97c1-36025e52fc48 => generated 1245 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:11:24.786010 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-9c25c50f-2799-47c3-afd5-05b16406da3e tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:24.786578 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-9c25c50f-2799-47c3-afd5-05b16406da3e tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:24.792583 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-9c25c50f-2799-47c3-afd5-05b16406da3e tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:24.793021 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-9c25c50f-2799-47c3-afd5-05b16406da3e tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:24.793795 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-9c25c50f-2799-47c3-afd5-05b16406da3e tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:24.794216 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-9c25c50f-2799-47c3-afd5-05b16406da3e tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:24.808012 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.wsgi [None req-9c25c50f-2799-47c3-afd5-05b16406da3e tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] HTTP exception thrown: Instance b07e385b-3d8f-4370-a8fc-013a1c785c0f could not be found. Jul 21 20:11:24.809616 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-9c25c50f-2799-47c3-afd5-05b16406da3e tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Request method failure captured: Jul 21 20:11:24.809616 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: request: GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f HTTP/1.1 Jul 21 20:11:24.809616 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Accept: application/json Jul 21 20:11:24.809616 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Accept-Encoding: identity Jul 21 20:11:24.809616 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Connection: close Jul 21 20:11:24.809616 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Content-Length: 0 Jul 21 20:11:24.809616 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Content-Type: application/json Jul 21 20:11:24.809616 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Host: 10.222.0.58 Jul 21 20:11:24.809616 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Openstack-System-Scope: None Jul 21 20:11:24.809616 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: User-Agent: python-urllib3/1.26.9 Jul 21 20:11:24.809616 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Auth-Token: gAAAAABi2bFmVNxr-PjOOkcTeCXQJ6pQ_y2iOz5ylVO9d7XyC54olaVFhrXWlH2Nketcv2tpxKRFAlpWv7eWy5Dm8T4JnG-iEELS8i5qTa4gA2jB410pUUqzV0CkFgwjk5v525thD23F61IAu7zoqYCKTp1dPl4sdyVA9Xz0i2zTX9M2Fj9lwR0 Jul 21 20:11:24.809616 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Domain-Id: None Jul 21 20:11:24.809616 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Domain-Name: None Jul 21 20:11:24.809616 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Identity-Status: Confirmed Jul 21 20:11:24.809616 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Is-Admin-Project: True Jul 21 20:11:24.809616 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Openstack-Nova-Api-Version: 2.20 Jul 21 20:11:24.809616 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Id: default Jul 21 20:11:24.809616 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Name: Default Jul 21 20:11:24.809616 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Id: f8ece8b465c04d33998002f8d880d556 Jul 21 20:11:24.809616 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1726184728 Jul 21 20:11:24.809616 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Role: reader,member Jul 21 20:11:24.809616 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Roles: reader,member Jul 21 20:11:24.816394 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f8ece8b465c04d33998002f8d880d556"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f8ece8b465c04d33998002f8d880d556"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f8ece8b465c04d33998002f8d880d556"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f8ece8b465c04d33998002f8d880d556"}]}] Jul 21 20:11:24.816394 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1726184728 Jul 21 20:11:24.816394 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Tenant-Id: f8ece8b465c04d33998002f8d880d556 Jul 21 20:11:24.816394 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1726184728 Jul 21 20:11:24.816394 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User: tempest-AttachVolumeShelveTestJSON-1726184728-project Jul 21 20:11:24.816394 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Id: default Jul 21 20:11:24.816394 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Name: Default Jul 21 20:11:24.816394 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Id: 02a93000972547d08f11f7ed23264d31 Jul 21 20:11:24.816394 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1726184728-project Jul 21 20:11:24.816394 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: method: > Jul 21 20:11:24.816394 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: exception: Instance b07e385b-3d8f-4370-a8fc-013a1c785c0f could not be found. Jul 21 20:11:24.816394 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: action_args: {'id': 'b07e385b-3d8f-4370-a8fc-013a1c785c0f'} Jul 21 20:11:24.817390 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 20:11:24.817390 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:11:24.817390 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 20:11:24.817390 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 20:11:24.817390 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 20:11:24.817390 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 20:11:24.817390 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 20:11:24.817390 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 20:11:24.817390 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 20:11:24.817390 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 20:11:24.817390 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b07e385b-3d8f-4370-a8fc-013a1c785c0f could not be found. Jul 21 20:11:24.817390 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:11:24.817390 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:11:24.817390 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:11:24.817390 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:11:24.817390 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:11:24.817390 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:11:24.817390 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 20:11:24.817390 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 20:11:24.817390 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 20:11:24.818932 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 20:11:24.818932 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 20:11:24.818932 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 20:11:24.818932 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 20:11:24.818932 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 20:11:24.818932 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 20:11:24.818932 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 20:11:24.818932 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b07e385b-3d8f-4370-a8fc-013a1c785c0f could not be found. Jul 21 20:11:24.818932 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:11:24.818932 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:11:24.818932 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:11:24.818932 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:11:24.818932 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:11:24.818932 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:11:24.818932 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 20:11:24.818932 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 20:11:24.818932 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b07e385b-3d8f-4370-a8fc-013a1c785c0f could not be found. Jul 21 20:11:24.818932 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:11:24.820261 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-9c25c50f-2799-47c3-afd5-05b16406da3e tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Returning 404 to user: Instance b07e385b-3d8f-4370-a8fc-013a1c785c0f could not be found. {{(pid=118345) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 20:11:24.820261 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-9c25c50f-2799-47c3-afd5-05b16406da3e tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 404 len: 111 microversion: 2.20 time: 0.029163 Jul 21 20:11:24.820261 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 335/647] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:11:24 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 21 20:11:24.821061 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-b90da2a9-bf77-4f93-9575-7790a1447107 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '.version_select at 0x7f351ccfce50>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:24.905733 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-b90da2a9-bf77-4f93-9575-7790a1447107 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-610516389" status: 204 len: 0 microversion: 2.20 time: 0.088967 Jul 21 20:11:24.906324 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 313/648] 10.222.0.58 () {60 vars in 1258 bytes} [Thu Jul 21 20:11:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-610516389 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 21 20:11:25.435649 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-364708f6-1b2e-47b1-b66f-ffbbaebd4fa0 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:25.436784 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-364708f6-1b2e-47b1-b66f-ffbbaebd4fa0 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: a41559e0-1fb6-44ef-97c1-36025e52fc48] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:25.443644 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-364708f6-1b2e-47b1-b66f-ffbbaebd4fa0 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:25.444086 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-364708f6-1b2e-47b1-b66f-ffbbaebd4fa0 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:25.444909 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-364708f6-1b2e-47b1-b66f-ffbbaebd4fa0 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:25.445514 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-364708f6-1b2e-47b1-b66f-ffbbaebd4fa0 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:25.516946 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-364708f6-1b2e-47b1-b66f-ffbbaebd4fa0 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:25.525244 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-364708f6-1b2e-47b1-b66f-ffbbaebd4fa0 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/a41559e0-1fb6-44ef-97c1-36025e52fc48" status: 200 len: 1301 microversion: 2.1 time: 0.093442 Jul 21 20:11:25.525953 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 336/649] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:11:25 2022] GET /compute/v2.1/servers/a41559e0-1fb6-44ef-97c1-36025e52fc48 => generated 1301 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:11:25.646461 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-769ef290-6ed8-45e5-9cf6-b681bb23d4ed tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Action: 'create', calling method: .version_select at 0x7f351ccb4ee0>, body: {"keypair": {"name": "tempest-keypair-1778725212", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNu691jheawbNeTsP1c2T0w9ZCMuh1ut0Lgv7AmBcmSTFn3R9Z3N0ioxX+W+66hl1lFelqsfVOD7FgGStv1A1xyesJNAytgDcHJXIbAScCd1Da4QxAWaH81t8ggYoYKqTQ=="}} {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:11:25.660840 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.quota [None req-769ef290-6ed8-45e5-9cf6-b681bb23d4ed tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Getting quotas for project f8ece8b465c04d33998002f8d880d556. Resources: {'key_pairs'} {{(pid=118344) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 20:11:25.664686 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.quota [None req-769ef290-6ed8-45e5-9cf6-b681bb23d4ed tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Getting quotas for user 02a93000972547d08f11f7ed23264d31 and project f8ece8b465c04d33998002f8d880d556. Resources: {'key_pairs'} {{(pid=118344) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 20:11:25.780663 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-769ef290-6ed8-45e5-9cf6-b681bb23d4ed tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.139629 Jul 21 20:11:25.781651 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 314/650] 10.222.0.58 () {62 vars in 1199 bytes} [Thu Jul 21 20:11:25 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 141 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 21 20:11:26.542960 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-4e5d670e-f5a3-4947-be23-580288bf6576 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:26.543728 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-4e5d670e-f5a3-4947-be23-580288bf6576 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: a41559e0-1fb6-44ef-97c1-36025e52fc48] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:26.552926 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4e5d670e-f5a3-4947-be23-580288bf6576 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:26.553387 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4e5d670e-f5a3-4947-be23-580288bf6576 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:26.554165 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4e5d670e-f5a3-4947-be23-580288bf6576 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:26.554631 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4e5d670e-f5a3-4947-be23-580288bf6576 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:26.756595 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-4e5d670e-f5a3-4947-be23-580288bf6576 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:26.764430 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-4e5d670e-f5a3-4947-be23-580288bf6576 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/a41559e0-1fb6-44ef-97c1-36025e52fc48" status: 200 len: 1367 microversion: 2.1 time: 0.225292 Jul 21 20:11:26.779908 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 337/651] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:11:26 2022] GET /compute/v2.1/servers/a41559e0-1fb6-44ef-97c1-36025e52fc48 => generated 1367 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:11:27.466336 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [req-ac223a08-d356-43b4-920c-012dd40b5bd6 req-b16013a2-1115-4fc7-8297-8de8b8f9f5f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a41559e0-1fb6-44ef-97c1-36025e52fc48", "tag": "5adf0c2c-829c-455c-8756-df9cea6504d6"}]} {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:11:27.477218 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [req-ac223a08-d356-43b4-920c-012dd40b5bd6 req-b16013a2-1115-4fc7-8297-8de8b8f9f5f2 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:27.477667 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [req-ac223a08-d356-43b4-920c-012dd40b5bd6 req-b16013a2-1115-4fc7-8297-8de8b8f9f5f2 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:27.490159 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.compute.server_external_events [req-ac223a08-d356-43b4-920c-012dd40b5bd6 req-b16013a2-1115-4fc7-8297-8de8b8f9f5f2 service nova] Creating event network-changed:5adf0c2c-829c-455c-8756-df9cea6504d6 for instance a41559e0-1fb6-44ef-97c1-36025e52fc48 on hv-cinder-85054 Jul 21 20:11:27.495706 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [req-ac223a08-d356-43b4-920c-012dd40b5bd6 req-b16013a2-1115-4fc7-8297-8de8b8f9f5f2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032949 Jul 21 20:11:27.496691 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 315/652] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 20:11:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:11:27.783049 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-78b04483-cc59-43ac-80c6-caf58f9d75e2 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:27.783669 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-78b04483-cc59-43ac-80c6-caf58f9d75e2 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: a41559e0-1fb6-44ef-97c1-36025e52fc48] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:27.791493 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-78b04483-cc59-43ac-80c6-caf58f9d75e2 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:27.791931 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-78b04483-cc59-43ac-80c6-caf58f9d75e2 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:27.792716 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-78b04483-cc59-43ac-80c6-caf58f9d75e2 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:27.793144 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-78b04483-cc59-43ac-80c6-caf58f9d75e2 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:27.967556 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-78b04483-cc59-43ac-80c6-caf58f9d75e2 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:27.975950 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-78b04483-cc59-43ac-80c6-caf58f9d75e2 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/a41559e0-1fb6-44ef-97c1-36025e52fc48" status: 200 len: 1367 microversion: 2.1 time: 0.198062 Jul 21 20:11:27.985000 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 338/653] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:11:27 2022] GET /compute/v2.1/servers/a41559e0-1fb6-44ef-97c1-36025e52fc48 => generated 1367 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:11:28.027203 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-74a93779-310d-4dd9-91a2-95eb491a830a tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1871720288", "imageRef": "357a1479-6cbd-4882-8d3f-d945fa40e6df", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ff765712-4fe3-49eb-a488-ee6e245cfbb3"}], "security_groups": [{"name": "tempest-securitygroup--1145037488"}], "key_name": "tempest-keypair-1778725212", "user_data": "}} {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:11:28.132895 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.network.neutron [None req-74a93779-310d-4dd9-91a2-95eb491a830a tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] validate_networks() for [('ff765712-4fe3-49eb-a488-ee6e245cfbb3', None, None, None, None, None)] {{(pid=118344) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 20:11:28.660703 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG dbcounter [-] [118344] Writing DB stats nova_cell0:SELECT=2 {{(pid=118344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:11:28.708631 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.virt.hardware [None req-74a93779-310d-4dd9-91a2-95eb491a830a tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Flavor limits 0:0:0 {{(pid=118344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 20:11:28.709054 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.virt.hardware [None req-74a93779-310d-4dd9-91a2-95eb491a830a tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Image limits 0:0:0 {{(pid=118344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 20:11:28.709525 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.virt.hardware [None req-74a93779-310d-4dd9-91a2-95eb491a830a tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Flavor pref 0:0:0 {{(pid=118344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 20:11:28.709930 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.virt.hardware [None req-74a93779-310d-4dd9-91a2-95eb491a830a tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Image pref 0:0:0 {{(pid=118344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 20:11:28.710339 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.virt.hardware [None req-74a93779-310d-4dd9-91a2-95eb491a830a tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 20:11:28.719848 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-74a93779-310d-4dd9-91a2-95eb491a830a tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:28.720308 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-74a93779-310d-4dd9-91a2-95eb491a830a tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:28.721366 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-74a93779-310d-4dd9-91a2-95eb491a830a tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:28.721828 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-74a93779-310d-4dd9-91a2-95eb491a830a tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:28.738275 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.quota [None req-74a93779-310d-4dd9-91a2-95eb491a830a tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Getting quotas for project f8ece8b465c04d33998002f8d880d556. Resources: {'instances', 'cores', 'ram'} {{(pid=118344) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 20:11:28.742434 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.quota [None req-74a93779-310d-4dd9-91a2-95eb491a830a tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Getting quotas for user 02a93000972547d08f11f7ed23264d31 and project f8ece8b465c04d33998002f8d880d556. Resources: {'instances', 'cores', 'ram'} {{(pid=118344) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 20:11:28.754730 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-74a93779-310d-4dd9-91a2-95eb491a830a tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Going to run 1 instances... {{(pid=118344) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 20:11:28.757121 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-74a93779-310d-4dd9-91a2-95eb491a830a tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: 5610f3fc-4e8b-48c0-a628-4b5c9419635a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='357a1479-6cbd-4882-8d3f-d945fa40e6df',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118344) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 20:11:28.767975 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG dbcounter [-] [118344] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=2,nova_api:INSERT=5 {{(pid=118344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:11:28.921114 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-74a93779-310d-4dd9-91a2-95eb491a830a tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.898620 Jul 21 20:11:28.921762 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 316/654] 10.222.0.58 () {62 vars in 1187 bytes} [Thu Jul 21 20:11:28 2022] POST /compute/v2.1/servers => generated 402 bytes in 900 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 21 20:11:28.931938 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-2034fef9-0db1-42f9-9704-ca9aebc80da8 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:28.932562 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-2034fef9-0db1-42f9-9704-ca9aebc80da8 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: 5610f3fc-4e8b-48c0-a628-4b5c9419635a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:28.987598 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-2034fef9-0db1-42f9-9704-ca9aebc80da8 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:29.002692 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-2034fef9-0db1-42f9-9704-ca9aebc80da8 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:29.002692 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-2034fef9-0db1-42f9-9704-ca9aebc80da8 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:29.002692 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-2034fef9-0db1-42f9-9704-ca9aebc80da8 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a" status: 200 len: 1282 microversion: 2.20 time: 0.072837 Jul 21 20:11:29.004147 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 339/655] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:11:28 2022] GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a => generated 1282 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:11:29.004230 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-b98f3e45-c647-4a0a-b2ba-7b19c4e2c47f tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:29.004230 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-b98f3e45-c647-4a0a-b2ba-7b19c4e2c47f tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: a41559e0-1fb6-44ef-97c1-36025e52fc48] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:29.010933 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-b98f3e45-c647-4a0a-b2ba-7b19c4e2c47f tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:29.011418 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-b98f3e45-c647-4a0a-b2ba-7b19c4e2c47f tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:29.012334 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-b98f3e45-c647-4a0a-b2ba-7b19c4e2c47f tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:29.012779 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-b98f3e45-c647-4a0a-b2ba-7b19c4e2c47f tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:29.144303 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-b98f3e45-c647-4a0a-b2ba-7b19c4e2c47f tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:29.151788 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-b98f3e45-c647-4a0a-b2ba-7b19c4e2c47f tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/a41559e0-1fb6-44ef-97c1-36025e52fc48" status: 200 len: 1367 microversion: 2.1 time: 0.154028 Jul 21 20:11:29.152457 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 317/656] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:11:28 2022] GET /compute/v2.1/servers/a41559e0-1fb6-44ef-97c1-36025e52fc48 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:11:30.020313 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-8d55fe58-896e-4255-9564-f2df82fbc44d tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:30.020831 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-8d55fe58-896e-4255-9564-f2df82fbc44d tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: 5610f3fc-4e8b-48c0-a628-4b5c9419635a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:30.026948 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8d55fe58-896e-4255-9564-f2df82fbc44d tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:30.027428 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8d55fe58-896e-4255-9564-f2df82fbc44d tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:30.028187 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8d55fe58-896e-4255-9564-f2df82fbc44d tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:30.028622 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8d55fe58-896e-4255-9564-f2df82fbc44d tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:30.093427 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-8d55fe58-896e-4255-9564-f2df82fbc44d tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:30.104614 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-8d55fe58-896e-4255-9564-f2df82fbc44d tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:30.106201 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-8d55fe58-896e-4255-9564-f2df82fbc44d tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:30.107318 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-8d55fe58-896e-4255-9564-f2df82fbc44d tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a" status: 200 len: 1286 microversion: 2.20 time: 0.091502 Jul 21 20:11:30.107874 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 340/657] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:11:30 2022] GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a => generated 1286 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:11:30.168663 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-06d08884-4a63-4e13-8700-7f0c437e5d54 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:30.169268 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-06d08884-4a63-4e13-8700-7f0c437e5d54 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: a41559e0-1fb6-44ef-97c1-36025e52fc48] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:30.175771 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-06d08884-4a63-4e13-8700-7f0c437e5d54 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:30.176217 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-06d08884-4a63-4e13-8700-7f0c437e5d54 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:30.176975 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-06d08884-4a63-4e13-8700-7f0c437e5d54 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:30.177431 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-06d08884-4a63-4e13-8700-7f0c437e5d54 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:30.306526 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-06d08884-4a63-4e13-8700-7f0c437e5d54 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:30.313805 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-06d08884-4a63-4e13-8700-7f0c437e5d54 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/a41559e0-1fb6-44ef-97c1-36025e52fc48" status: 200 len: 1367 microversion: 2.1 time: 0.149096 Jul 21 20:11:30.314370 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 318/658] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:11:30 2022] GET /compute/v2.1/servers/a41559e0-1fb6-44ef-97c1-36025e52fc48 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:11:31.125822 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-c468289e-0f89-4294-a1bc-bea9c65567a2 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:31.126411 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-c468289e-0f89-4294-a1bc-bea9c65567a2 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: 5610f3fc-4e8b-48c0-a628-4b5c9419635a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:31.134026 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c468289e-0f89-4294-a1bc-bea9c65567a2 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:31.134468 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c468289e-0f89-4294-a1bc-bea9c65567a2 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:31.135260 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c468289e-0f89-4294-a1bc-bea9c65567a2 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:31.141006 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c468289e-0f89-4294-a1bc-bea9c65567a2 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:31.196085 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-c468289e-0f89-4294-a1bc-bea9c65567a2 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:31.203996 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-c468289e-0f89-4294-a1bc-bea9c65567a2 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:31.205555 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-c468289e-0f89-4294-a1bc-bea9c65567a2 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:31.206694 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-c468289e-0f89-4294-a1bc-bea9c65567a2 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a" status: 200 len: 1286 microversion: 2.20 time: 0.084769 Jul 21 20:11:31.207286 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 341/659] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:11:31 2022] GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a => generated 1286 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:11:31.332123 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-9a60b291-32e4-46ae-a8cf-0a99b85f71f1 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:31.333153 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-9a60b291-32e4-46ae-a8cf-0a99b85f71f1 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: a41559e0-1fb6-44ef-97c1-36025e52fc48] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:31.338994 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-9a60b291-32e4-46ae-a8cf-0a99b85f71f1 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:31.339463 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-9a60b291-32e4-46ae-a8cf-0a99b85f71f1 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:31.340219 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-9a60b291-32e4-46ae-a8cf-0a99b85f71f1 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:31.340645 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-9a60b291-32e4-46ae-a8cf-0a99b85f71f1 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:31.473187 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-9a60b291-32e4-46ae-a8cf-0a99b85f71f1 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:31.480629 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-9a60b291-32e4-46ae-a8cf-0a99b85f71f1 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/a41559e0-1fb6-44ef-97c1-36025e52fc48" status: 200 len: 1367 microversion: 2.1 time: 0.153295 Jul 21 20:11:31.481198 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 319/660] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:11:31 2022] GET /compute/v2.1/servers/a41559e0-1fb6-44ef-97c1-36025e52fc48 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:11:32.016559 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-d3a6e9ee-dd30-4980-800a-08b3d24192a0 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:11:32.017008 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-d3a6e9ee-dd30-4980-800a-08b3d24192a0 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] [instance: 301ed3ad-5cb4-4ebf-ac32-519ab482cdea] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:32.023956 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d3a6e9ee-dd30-4980-800a-08b3d24192a0 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:32.024391 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d3a6e9ee-dd30-4980-800a-08b3d24192a0 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:32.025181 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d3a6e9ee-dd30-4980-800a-08b3d24192a0 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:32.025611 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d3a6e9ee-dd30-4980-800a-08b3d24192a0 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:32.048233 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.objects.instance [None req-d3a6e9ee-dd30-4980-800a-08b3d24192a0 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lazy-loading 'flavor' on Instance uuid 301ed3ad-5cb4-4ebf-ac32-519ab482cdea {{(pid=118345) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 20:11:32.225245 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-dc736b33-3900-4c52-a25e-0cf51cdd6c03 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:32.225930 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-dc736b33-3900-4c52-a25e-0cf51cdd6c03 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: 5610f3fc-4e8b-48c0-a628-4b5c9419635a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:32.231989 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-dc736b33-3900-4c52-a25e-0cf51cdd6c03 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:32.232612 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-dc736b33-3900-4c52-a25e-0cf51cdd6c03 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:32.241422 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-dc736b33-3900-4c52-a25e-0cf51cdd6c03 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:32.241860 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-dc736b33-3900-4c52-a25e-0cf51cdd6c03 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:32.305883 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-dc736b33-3900-4c52-a25e-0cf51cdd6c03 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:32.313875 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-dc736b33-3900-4c52-a25e-0cf51cdd6c03 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:32.315984 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-dc736b33-3900-4c52-a25e-0cf51cdd6c03 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:32.317102 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-dc736b33-3900-4c52-a25e-0cf51cdd6c03 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a" status: 200 len: 1342 microversion: 2.20 time: 0.096416 Jul 21 20:11:32.317731 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 320/661] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:11:32 2022] GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a => generated 1342 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 20:11:32.335397 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-d3a6e9ee-dd30-4980-800a-08b3d24192a0 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] 10.222.0.58 "POST /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea/action" status: 202 len: 0 microversion: 2.1 time: 0.322628 Jul 21 20:11:32.340095 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 342/662] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Jul 21 20:11:32 2022] POST /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea/action => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 20:11:32.345237 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-1260acbd-1d2d-4d55-8745-fb8be02a7ec9 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:32.347113 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-1260acbd-1d2d-4d55-8745-fb8be02a7ec9 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] [instance: 301ed3ad-5cb4-4ebf-ac32-519ab482cdea] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:32.354936 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-1260acbd-1d2d-4d55-8745-fb8be02a7ec9 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:32.355562 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-1260acbd-1d2d-4d55-8745-fb8be02a7ec9 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:32.356357 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-1260acbd-1d2d-4d55-8745-fb8be02a7ec9 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:32.356967 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-1260acbd-1d2d-4d55-8745-fb8be02a7ec9 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:32.498314 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-bdb2726a-c1e7-4c5a-8d24-3fd584b14fcf tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:32.498803 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-bdb2726a-c1e7-4c5a-8d24-3fd584b14fcf tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: a41559e0-1fb6-44ef-97c1-36025e52fc48] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:32.501339 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-1260acbd-1d2d-4d55-8745-fb8be02a7ec9 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf78e0fe86d4e078c0527248af45cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4239f4ae39bb49cf8063377a93875456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:32.506022 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-bdb2726a-c1e7-4c5a-8d24-3fd584b14fcf tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:32.506468 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-bdb2726a-c1e7-4c5a-8d24-3fd584b14fcf tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:32.507265 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-bdb2726a-c1e7-4c5a-8d24-3fd584b14fcf tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:32.507749 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-bdb2726a-c1e7-4c5a-8d24-3fd584b14fcf tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:32.509834 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-1260acbd-1d2d-4d55-8745-fb8be02a7ec9 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] 10.222.0.58 "GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea" status: 200 len: 1568 microversion: 2.1 time: 0.169336 Jul 21 20:11:32.510405 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 321/663] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:11:32 2022] GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:11:32.708721 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-bdb2726a-c1e7-4c5a-8d24-3fd584b14fcf tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:32.716232 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-bdb2726a-c1e7-4c5a-8d24-3fd584b14fcf tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/a41559e0-1fb6-44ef-97c1-36025e52fc48" status: 200 len: 1367 microversion: 2.1 time: 0.222515 Jul 21 20:11:32.716799 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 343/664] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:11:32 2022] GET /compute/v2.1/servers/a41559e0-1fb6-44ef-97c1-36025e52fc48 => generated 1367 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:11:33.335580 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-0f7d6b02-ac78-4d66-979f-c02c4c7e3cb3 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:33.336441 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-0f7d6b02-ac78-4d66-979f-c02c4c7e3cb3 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: 5610f3fc-4e8b-48c0-a628-4b5c9419635a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:33.345991 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-0f7d6b02-ac78-4d66-979f-c02c4c7e3cb3 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:33.348201 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-0f7d6b02-ac78-4d66-979f-c02c4c7e3cb3 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:33.349813 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-0f7d6b02-ac78-4d66-979f-c02c4c7e3cb3 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:33.350452 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-0f7d6b02-ac78-4d66-979f-c02c4c7e3cb3 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:33.489621 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-0f7d6b02-ac78-4d66-979f-c02c4c7e3cb3 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:33.498030 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-0f7d6b02-ac78-4d66-979f-c02c4c7e3cb3 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:33.499594 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-0f7d6b02-ac78-4d66-979f-c02c4c7e3cb3 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:33.500889 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-0f7d6b02-ac78-4d66-979f-c02c4c7e3cb3 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a" status: 200 len: 1408 microversion: 2.20 time: 0.169464 Jul 21 20:11:33.501719 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 322/665] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:11:33 2022] GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a => generated 1408 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 20:11:33.528088 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-853437c3-cc9a-4dd4-835d-937c46526c06 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:33.529282 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-853437c3-cc9a-4dd4-835d-937c46526c06 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] [instance: 301ed3ad-5cb4-4ebf-ac32-519ab482cdea] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:33.535520 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-853437c3-cc9a-4dd4-835d-937c46526c06 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:33.536146 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-853437c3-cc9a-4dd4-835d-937c46526c06 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:33.536907 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-853437c3-cc9a-4dd4-835d-937c46526c06 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:33.537258 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-853437c3-cc9a-4dd4-835d-937c46526c06 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:33.711530 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-853437c3-cc9a-4dd4-835d-937c46526c06 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf78e0fe86d4e078c0527248af45cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4239f4ae39bb49cf8063377a93875456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:33.719425 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-853437c3-cc9a-4dd4-835d-937c46526c06 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] 10.222.0.58 "GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea" status: 200 len: 1568 microversion: 2.1 time: 0.195366 Jul 21 20:11:33.719998 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 344/666] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:11:33 2022] GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea => generated 1568 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:11:33.733586 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-a1124b40-fd95-4bde-b762-b70d151874a9 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:33.734192 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-a1124b40-fd95-4bde-b762-b70d151874a9 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: a41559e0-1fb6-44ef-97c1-36025e52fc48] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:33.740672 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-a1124b40-fd95-4bde-b762-b70d151874a9 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:33.741112 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-a1124b40-fd95-4bde-b762-b70d151874a9 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:33.741869 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-a1124b40-fd95-4bde-b762-b70d151874a9 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:33.742299 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-a1124b40-fd95-4bde-b762-b70d151874a9 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:33.890015 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-a1124b40-fd95-4bde-b762-b70d151874a9 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:33.900234 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-a1124b40-fd95-4bde-b762-b70d151874a9 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/a41559e0-1fb6-44ef-97c1-36025e52fc48" status: 200 len: 1367 microversion: 2.1 time: 0.170290 Jul 21 20:11:33.911103 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 323/667] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:11:33 2022] GET /compute/v2.1/servers/a41559e0-1fb6-44ef-97c1-36025e52fc48 => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:11:34.264857 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [req-38c33d1d-03a0-477b-8c23-8bc3ba752d3d req-eca15b0b-999b-469d-b621-ce3cc7b94ba6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5610f3fc-4e8b-48c0-a628-4b5c9419635a", "tag": "c9b7a4f8-5df1-449c-9157-130a564accea"}]} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:11:34.273978 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-38c33d1d-03a0-477b-8c23-8bc3ba752d3d req-eca15b0b-999b-469d-b621-ce3cc7b94ba6 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:34.274516 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-38c33d1d-03a0-477b-8c23-8bc3ba752d3d req-eca15b0b-999b-469d-b621-ce3cc7b94ba6 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:34.288437 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.compute.server_external_events [req-38c33d1d-03a0-477b-8c23-8bc3ba752d3d req-eca15b0b-999b-469d-b621-ce3cc7b94ba6 service nova] Creating event network-changed:c9b7a4f8-5df1-449c-9157-130a564accea for instance 5610f3fc-4e8b-48c0-a628-4b5c9419635a on hv-cinder-85054 Jul 21 20:11:34.292819 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [req-38c33d1d-03a0-477b-8c23-8bc3ba752d3d req-eca15b0b-999b-469d-b621-ce3cc7b94ba6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031816 Jul 21 20:11:34.294252 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 345/668] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 20:11:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 20:11:34.520000 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-3467a4dd-f522-4cc0-9dec-e5532ed09438 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:34.520538 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-3467a4dd-f522-4cc0-9dec-e5532ed09438 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: 5610f3fc-4e8b-48c0-a628-4b5c9419635a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:34.527459 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-3467a4dd-f522-4cc0-9dec-e5532ed09438 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:34.527909 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-3467a4dd-f522-4cc0-9dec-e5532ed09438 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:34.528685 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-3467a4dd-f522-4cc0-9dec-e5532ed09438 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:34.529116 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-3467a4dd-f522-4cc0-9dec-e5532ed09438 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:34.660140 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-3467a4dd-f522-4cc0-9dec-e5532ed09438 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:34.669077 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-3467a4dd-f522-4cc0-9dec-e5532ed09438 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:34.670597 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-3467a4dd-f522-4cc0-9dec-e5532ed09438 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:34.678763 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-3467a4dd-f522-4cc0-9dec-e5532ed09438 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a" status: 200 len: 1408 microversion: 2.20 time: 0.156098 Jul 21 20:11:34.678763 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 324/669] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:11:34 2022] GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a => generated 1408 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:11:34.737947 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-1fff8a9e-b4a7-4859-abe0-d8f28bea85f9 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:34.738563 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-1fff8a9e-b4a7-4859-abe0-d8f28bea85f9 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] [instance: 301ed3ad-5cb4-4ebf-ac32-519ab482cdea] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:34.744912 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1fff8a9e-b4a7-4859-abe0-d8f28bea85f9 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:34.745391 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1fff8a9e-b4a7-4859-abe0-d8f28bea85f9 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:34.746170 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1fff8a9e-b4a7-4859-abe0-d8f28bea85f9 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:34.746600 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1fff8a9e-b4a7-4859-abe0-d8f28bea85f9 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:34.920067 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-81f99aab-a071-4037-ac76-54859041a07b tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:34.920795 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-81f99aab-a071-4037-ac76-54859041a07b tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: a41559e0-1fb6-44ef-97c1-36025e52fc48] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:34.927084 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-81f99aab-a071-4037-ac76-54859041a07b tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:34.927607 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-81f99aab-a071-4037-ac76-54859041a07b tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:34.928447 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-81f99aab-a071-4037-ac76-54859041a07b tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:34.928954 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-81f99aab-a071-4037-ac76-54859041a07b tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:34.965214 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-1fff8a9e-b4a7-4859-abe0-d8f28bea85f9 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf78e0fe86d4e078c0527248af45cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4239f4ae39bb49cf8063377a93875456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:34.973523 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-1fff8a9e-b4a7-4859-abe0-d8f28bea85f9 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] 10.222.0.58 "GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea" status: 200 len: 1568 microversion: 2.1 time: 0.239935 Jul 21 20:11:34.974397 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 346/670] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:11:34 2022] GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea => generated 1568 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:11:35.063771 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-81f99aab-a071-4037-ac76-54859041a07b tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:35.072196 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-81f99aab-a071-4037-ac76-54859041a07b tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/a41559e0-1fb6-44ef-97c1-36025e52fc48" status: 200 len: 1367 microversion: 2.1 time: 0.156167 Jul 21 20:11:35.072770 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 325/671] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:11:34 2022] GET /compute/v2.1/servers/a41559e0-1fb6-44ef-97c1-36025e52fc48 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:11:35.492571 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [req-cc871a67-8e37-4165-9e7d-1d9661581dbb req-72f91451-86c6-4e57-9261-92aa2cbb7348 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a41559e0-1fb6-44ef-97c1-36025e52fc48", "name": "network-vif-plugged", "status": "completed", "tag": "5adf0c2c-829c-455c-8756-df9cea6504d6"}]} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:11:35.500505 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-cc871a67-8e37-4165-9e7d-1d9661581dbb req-72f91451-86c6-4e57-9261-92aa2cbb7348 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:35.500948 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-cc871a67-8e37-4165-9e7d-1d9661581dbb req-72f91451-86c6-4e57-9261-92aa2cbb7348 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:35.504856 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:11:35.511787 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.compute.server_external_events [req-cc871a67-8e37-4165-9e7d-1d9661581dbb req-72f91451-86c6-4e57-9261-92aa2cbb7348 service nova] Creating event network-vif-plugged:5adf0c2c-829c-455c-8756-df9cea6504d6 for instance a41559e0-1fb6-44ef-97c1-36025e52fc48 on hv-cinder-85054 Jul 21 20:11:35.516488 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [req-cc871a67-8e37-4165-9e7d-1d9661581dbb req-72f91451-86c6-4e57-9261-92aa2cbb7348 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082069 Jul 21 20:11:35.517051 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 347/672] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 20:11:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:11:35.689784 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-43e5ab70-7fb0-4d70-8330-ddddb58eb2f5 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:35.690932 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-43e5ab70-7fb0-4d70-8330-ddddb58eb2f5 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: 5610f3fc-4e8b-48c0-a628-4b5c9419635a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:35.697499 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-43e5ab70-7fb0-4d70-8330-ddddb58eb2f5 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:35.697996 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-43e5ab70-7fb0-4d70-8330-ddddb58eb2f5 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:35.698751 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-43e5ab70-7fb0-4d70-8330-ddddb58eb2f5 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:35.699203 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-43e5ab70-7fb0-4d70-8330-ddddb58eb2f5 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:35.830926 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-43e5ab70-7fb0-4d70-8330-ddddb58eb2f5 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:35.838939 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-43e5ab70-7fb0-4d70-8330-ddddb58eb2f5 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:35.840429 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-43e5ab70-7fb0-4d70-8330-ddddb58eb2f5 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:35.841530 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-43e5ab70-7fb0-4d70-8330-ddddb58eb2f5 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a" status: 200 len: 1408 microversion: 2.20 time: 0.155670 Jul 21 20:11:35.842103 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 326/673] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:11:35 2022] GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a => generated 1408 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:11:35.991391 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-134efaf5-68af-4dbd-93e9-a500dde8243a tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:35.992089 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-134efaf5-68af-4dbd-93e9-a500dde8243a tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] [instance: 301ed3ad-5cb4-4ebf-ac32-519ab482cdea] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:35.998869 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-134efaf5-68af-4dbd-93e9-a500dde8243a tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:35.999342 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-134efaf5-68af-4dbd-93e9-a500dde8243a tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:36.000107 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-134efaf5-68af-4dbd-93e9-a500dde8243a tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:36.000539 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-134efaf5-68af-4dbd-93e9-a500dde8243a tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:36.089084 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-15e41b99-35ab-4d27-ada4-a9053a5491d9 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:36.089740 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-15e41b99-35ab-4d27-ada4-a9053a5491d9 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: a41559e0-1fb6-44ef-97c1-36025e52fc48] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:36.095910 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-15e41b99-35ab-4d27-ada4-a9053a5491d9 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:36.096423 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-15e41b99-35ab-4d27-ada4-a9053a5491d9 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:36.097272 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-15e41b99-35ab-4d27-ada4-a9053a5491d9 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:36.097768 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-15e41b99-35ab-4d27-ada4-a9053a5491d9 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:36.132180 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-134efaf5-68af-4dbd-93e9-a500dde8243a tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf78e0fe86d4e078c0527248af45cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4239f4ae39bb49cf8063377a93875456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:36.140103 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-134efaf5-68af-4dbd-93e9-a500dde8243a tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] 10.222.0.58 "GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea" status: 200 len: 1568 microversion: 2.1 time: 0.153437 Jul 21 20:11:36.140765 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 348/674] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:11:35 2022] GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:11:36.232186 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-15e41b99-35ab-4d27-ada4-a9053a5491d9 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:36.239625 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-15e41b99-35ab-4d27-ada4-a9053a5491d9 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/a41559e0-1fb6-44ef-97c1-36025e52fc48" status: 200 len: 1367 microversion: 2.1 time: 0.154494 Jul 21 20:11:36.240193 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 327/675] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:11:36 2022] GET /compute/v2.1/servers/a41559e0-1fb6-44ef-97c1-36025e52fc48 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:11:36.859126 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-fbbcbcc4-bf27-4c8f-a6ca-1ac82f5208a6 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:36.859748 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-fbbcbcc4-bf27-4c8f-a6ca-1ac82f5208a6 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: 5610f3fc-4e8b-48c0-a628-4b5c9419635a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:36.861663 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:11:36.866821 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-fbbcbcc4-bf27-4c8f-a6ca-1ac82f5208a6 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:36.867290 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-fbbcbcc4-bf27-4c8f-a6ca-1ac82f5208a6 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:36.868060 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-fbbcbcc4-bf27-4c8f-a6ca-1ac82f5208a6 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:36.868480 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-fbbcbcc4-bf27-4c8f-a6ca-1ac82f5208a6 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:36.999708 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-fbbcbcc4-bf27-4c8f-a6ca-1ac82f5208a6 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:37.007782 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-fbbcbcc4-bf27-4c8f-a6ca-1ac82f5208a6 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:37.009274 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-fbbcbcc4-bf27-4c8f-a6ca-1ac82f5208a6 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:37.010373 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-fbbcbcc4-bf27-4c8f-a6ca-1ac82f5208a6 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a" status: 200 len: 1408 microversion: 2.20 time: 0.155226 Jul 21 20:11:37.010929 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 349/676] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:11:36 2022] GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a => generated 1408 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:11:37.157570 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-7d56d786-ea1b-4b7d-bb89-289c8fabb55e tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:37.158171 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-7d56d786-ea1b-4b7d-bb89-289c8fabb55e tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] [instance: 301ed3ad-5cb4-4ebf-ac32-519ab482cdea] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:37.165266 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-7d56d786-ea1b-4b7d-bb89-289c8fabb55e tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:37.165712 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-7d56d786-ea1b-4b7d-bb89-289c8fabb55e tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:37.166470 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-7d56d786-ea1b-4b7d-bb89-289c8fabb55e tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:37.166902 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-7d56d786-ea1b-4b7d-bb89-289c8fabb55e tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:37.170758 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG dbcounter [-] [118344] Writing DB stats nova_cell1:SELECT=100 {{(pid=118344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:11:37.256228 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-d7881e63-a582-4bc7-b067-0308e838ac52 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:37.256836 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-d7881e63-a582-4bc7-b067-0308e838ac52 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: a41559e0-1fb6-44ef-97c1-36025e52fc48] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:37.262976 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d7881e63-a582-4bc7-b067-0308e838ac52 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:37.263459 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d7881e63-a582-4bc7-b067-0308e838ac52 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:37.264225 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d7881e63-a582-4bc7-b067-0308e838ac52 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:37.264662 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d7881e63-a582-4bc7-b067-0308e838ac52 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:37.301810 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-7d56d786-ea1b-4b7d-bb89-289c8fabb55e tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf78e0fe86d4e078c0527248af45cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4239f4ae39bb49cf8063377a93875456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:37.309599 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-7d56d786-ea1b-4b7d-bb89-289c8fabb55e tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] 10.222.0.58 "GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea" status: 200 len: 1568 microversion: 2.1 time: 0.155921 Jul 21 20:11:37.310351 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 328/677] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:11:37 2022] GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:11:37.391251 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-d7881e63-a582-4bc7-b067-0308e838ac52 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:37.399056 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-d7881e63-a582-4bc7-b067-0308e838ac52 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/a41559e0-1fb6-44ef-97c1-36025e52fc48" status: 200 len: 1367 microversion: 2.1 time: 0.146690 Jul 21 20:11:37.399615 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 350/678] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:11:37 2022] GET /compute/v2.1/servers/a41559e0-1fb6-44ef-97c1-36025e52fc48 => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:11:38.027634 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-81c966ee-66f0-48b5-b4c7-f7e98c605a07 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:38.028241 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-81c966ee-66f0-48b5-b4c7-f7e98c605a07 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: 5610f3fc-4e8b-48c0-a628-4b5c9419635a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:38.034157 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-81c966ee-66f0-48b5-b4c7-f7e98c605a07 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:38.034594 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-81c966ee-66f0-48b5-b4c7-f7e98c605a07 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:38.035395 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-81c966ee-66f0-48b5-b4c7-f7e98c605a07 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:38.035845 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-81c966ee-66f0-48b5-b4c7-f7e98c605a07 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:38.163293 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-81c966ee-66f0-48b5-b4c7-f7e98c605a07 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:38.171799 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-81c966ee-66f0-48b5-b4c7-f7e98c605a07 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:38.173430 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-81c966ee-66f0-48b5-b4c7-f7e98c605a07 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:38.174563 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-81c966ee-66f0-48b5-b4c7-f7e98c605a07 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a" status: 200 len: 1408 microversion: 2.20 time: 0.150967 Jul 21 20:11:38.175153 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 329/679] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:11:38 2022] GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a => generated 1408 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:11:38.326647 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-79b45ae8-28cc-4097-9517-a91e0e337702 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:38.327283 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-79b45ae8-28cc-4097-9517-a91e0e337702 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] [instance: 301ed3ad-5cb4-4ebf-ac32-519ab482cdea] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:38.333189 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-79b45ae8-28cc-4097-9517-a91e0e337702 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:38.333629 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-79b45ae8-28cc-4097-9517-a91e0e337702 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:38.334371 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-79b45ae8-28cc-4097-9517-a91e0e337702 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:38.334796 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-79b45ae8-28cc-4097-9517-a91e0e337702 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:38.415754 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-4c7bb9e0-7328-4a74-b046-143ed98a7ca4 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:38.416369 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-4c7bb9e0-7328-4a74-b046-143ed98a7ca4 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: a41559e0-1fb6-44ef-97c1-36025e52fc48] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:38.422322 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-4c7bb9e0-7328-4a74-b046-143ed98a7ca4 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:38.422772 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-4c7bb9e0-7328-4a74-b046-143ed98a7ca4 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:38.423564 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-4c7bb9e0-7328-4a74-b046-143ed98a7ca4 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:38.424002 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-4c7bb9e0-7328-4a74-b046-143ed98a7ca4 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:38.467965 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-79b45ae8-28cc-4097-9517-a91e0e337702 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf78e0fe86d4e078c0527248af45cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4239f4ae39bb49cf8063377a93875456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:38.475786 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-79b45ae8-28cc-4097-9517-a91e0e337702 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] 10.222.0.58 "GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea" status: 200 len: 1568 microversion: 2.1 time: 0.152979 Jul 21 20:11:38.476360 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 351/680] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:11:38 2022] GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:11:38.553601 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-4c7bb9e0-7328-4a74-b046-143ed98a7ca4 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:38.561089 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-4c7bb9e0-7328-4a74-b046-143ed98a7ca4 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/a41559e0-1fb6-44ef-97c1-36025e52fc48" status: 200 len: 1367 microversion: 2.1 time: 0.149224 Jul 21 20:11:38.561662 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 330/681] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:11:38 2022] GET /compute/v2.1/servers/a41559e0-1fb6-44ef-97c1-36025e52fc48 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:11:39.193873 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-20d156e2-59b6-4615-b79c-ae7466284c48 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:39.194469 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-20d156e2-59b6-4615-b79c-ae7466284c48 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: 5610f3fc-4e8b-48c0-a628-4b5c9419635a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:39.196339 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell0:SELECT=8 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:11:39.201229 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-20d156e2-59b6-4615-b79c-ae7466284c48 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:39.207524 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-20d156e2-59b6-4615-b79c-ae7466284c48 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:39.207524 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-20d156e2-59b6-4615-b79c-ae7466284c48 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:39.207524 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-20d156e2-59b6-4615-b79c-ae7466284c48 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:39.335498 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-20d156e2-59b6-4615-b79c-ae7466284c48 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:39.343408 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-20d156e2-59b6-4615-b79c-ae7466284c48 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:39.344917 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-20d156e2-59b6-4615-b79c-ae7466284c48 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:39.349636 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-20d156e2-59b6-4615-b79c-ae7466284c48 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a" status: 200 len: 1408 microversion: 2.20 time: 0.156890 Jul 21 20:11:39.349636 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 352/682] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:11:39 2022] GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a => generated 1408 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:11:39.493258 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-59581b0b-2dc6-427d-bc8a-2a2511859842 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:39.493864 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-59581b0b-2dc6-427d-bc8a-2a2511859842 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] [instance: 301ed3ad-5cb4-4ebf-ac32-519ab482cdea] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:39.495755 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG dbcounter [-] [118344] Writing DB stats nova_cell0:SELECT=2 {{(pid=118344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:11:39.496427 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG dbcounter [-] [118344] Writing DB stats nova_cell0:SELECT=22 {{(pid=118344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:11:39.501698 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-59581b0b-2dc6-427d-bc8a-2a2511859842 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:39.502175 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-59581b0b-2dc6-427d-bc8a-2a2511859842 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:39.502940 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-59581b0b-2dc6-427d-bc8a-2a2511859842 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:39.503406 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-59581b0b-2dc6-427d-bc8a-2a2511859842 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:39.577791 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-abc35077-2ca2-481a-b0f0-68d8bcfd2138 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:39.578635 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-abc35077-2ca2-481a-b0f0-68d8bcfd2138 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: a41559e0-1fb6-44ef-97c1-36025e52fc48] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:39.584630 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-abc35077-2ca2-481a-b0f0-68d8bcfd2138 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:39.585076 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-abc35077-2ca2-481a-b0f0-68d8bcfd2138 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:39.585836 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-abc35077-2ca2-481a-b0f0-68d8bcfd2138 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:39.586270 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-abc35077-2ca2-481a-b0f0-68d8bcfd2138 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:39.638275 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-59581b0b-2dc6-427d-bc8a-2a2511859842 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf78e0fe86d4e078c0527248af45cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4239f4ae39bb49cf8063377a93875456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:39.646859 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-59581b0b-2dc6-427d-bc8a-2a2511859842 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] 10.222.0.58 "GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea" status: 200 len: 1568 microversion: 2.1 time: 0.157950 Jul 21 20:11:39.647537 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 331/683] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:11:39 2022] GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:11:39.957687 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-abc35077-2ca2-481a-b0f0-68d8bcfd2138 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:39.965725 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-abc35077-2ca2-481a-b0f0-68d8bcfd2138 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/a41559e0-1fb6-44ef-97c1-36025e52fc48" status: 200 len: 1367 microversion: 2.1 time: 0.391862 Jul 21 20:11:39.974138 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 353/684] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:11:39 2022] GET /compute/v2.1/servers/a41559e0-1fb6-44ef-97c1-36025e52fc48 => generated 1367 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:11:40.240447 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 20:11:40.240702 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Thu Jul 21 20:11:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 20:11:40.365292 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-c21d414b-0cfd-493e-a469-037ec7be39e6 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:40.365906 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-c21d414b-0cfd-493e-a469-037ec7be39e6 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: 5610f3fc-4e8b-48c0-a628-4b5c9419635a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:40.371959 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-c21d414b-0cfd-493e-a469-037ec7be39e6 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:40.372415 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-c21d414b-0cfd-493e-a469-037ec7be39e6 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:40.373169 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-c21d414b-0cfd-493e-a469-037ec7be39e6 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:40.373604 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-c21d414b-0cfd-493e-a469-037ec7be39e6 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:40.503141 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-c21d414b-0cfd-493e-a469-037ec7be39e6 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:40.511607 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-c21d414b-0cfd-493e-a469-037ec7be39e6 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:40.513105 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-c21d414b-0cfd-493e-a469-037ec7be39e6 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:40.514202 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-c21d414b-0cfd-493e-a469-037ec7be39e6 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a" status: 200 len: 1408 microversion: 2.20 time: 0.153510 Jul 21 20:11:40.514764 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 332/685] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:11:40 2022] GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a => generated 1408 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:11:40.664302 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-b76249b9-34e5-45d6-b115-1e1ec6091add tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:40.665070 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-b76249b9-34e5-45d6-b115-1e1ec6091add tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] [instance: 301ed3ad-5cb4-4ebf-ac32-519ab482cdea] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:40.671276 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b76249b9-34e5-45d6-b115-1e1ec6091add tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:40.671724 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b76249b9-34e5-45d6-b115-1e1ec6091add tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:40.672479 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b76249b9-34e5-45d6-b115-1e1ec6091add tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:40.672910 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b76249b9-34e5-45d6-b115-1e1ec6091add tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:40.803040 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-b76249b9-34e5-45d6-b115-1e1ec6091add tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf78e0fe86d4e078c0527248af45cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4239f4ae39bb49cf8063377a93875456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:40.810482 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-b76249b9-34e5-45d6-b115-1e1ec6091add tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] 10.222.0.58 "GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea" status: 200 len: 1568 microversion: 2.1 time: 0.150911 Jul 21 20:11:40.811069 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 354/686] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:11:40 2022] GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:11:40.982884 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-5a076d16-5904-4d8a-98c6-5425f5582aa8 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:40.983535 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-5a076d16-5904-4d8a-98c6-5425f5582aa8 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: a41559e0-1fb6-44ef-97c1-36025e52fc48] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:40.989528 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-5a076d16-5904-4d8a-98c6-5425f5582aa8 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:40.989978 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-5a076d16-5904-4d8a-98c6-5425f5582aa8 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:40.990747 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-5a076d16-5904-4d8a-98c6-5425f5582aa8 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:40.991216 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-5a076d16-5904-4d8a-98c6-5425f5582aa8 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:41.122092 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-5a076d16-5904-4d8a-98c6-5425f5582aa8 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:41.129625 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-5a076d16-5904-4d8a-98c6-5425f5582aa8 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/a41559e0-1fb6-44ef-97c1-36025e52fc48" status: 200 len: 1558 microversion: 2.1 time: 0.150636 Jul 21 20:11:41.130237 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 333/687] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:11:40 2022] GET /compute/v2.1/servers/a41559e0-1fb6-44ef-97c1-36025e52fc48 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:11:41.146568 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-2c9fac5a-af01-4873-a347-5d6fe20d413d tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:41.147084 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-2c9fac5a-af01-4873-a347-5d6fe20d413d tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: a41559e0-1fb6-44ef-97c1-36025e52fc48] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:41.153115 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2c9fac5a-af01-4873-a347-5d6fe20d413d tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:41.153592 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2c9fac5a-af01-4873-a347-5d6fe20d413d tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:41.154349 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2c9fac5a-af01-4873-a347-5d6fe20d413d tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:41.154782 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2c9fac5a-af01-4873-a347-5d6fe20d413d tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:41.231215 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-2c9fac5a-af01-4873-a347-5d6fe20d413d tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/a41559e0-1fb6-44ef-97c1-36025e52fc48/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088918 Jul 21 20:11:41.231809 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 355/688] 10.222.0.58 () {58 vars in 1274 bytes} [Thu Jul 21 20:11:41 2022] GET /compute/v2.1/servers/a41559e0-1fb6-44ef-97c1-36025e52fc48/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:11:41.511423 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [req-1b8d8750-68c8-42b0-8a46-d3939cd96528 req-ca1759b6-ffd6-43f2-b46f-b329f64d784d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5610f3fc-4e8b-48c0-a628-4b5c9419635a", "name": "network-vif-plugged", "status": "completed", "tag": "c9b7a4f8-5df1-449c-9157-130a564accea"}]} {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:11:41.519814 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [req-1b8d8750-68c8-42b0-8a46-d3939cd96528 req-ca1759b6-ffd6-43f2-b46f-b329f64d784d service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:41.520264 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [req-1b8d8750-68c8-42b0-8a46-d3939cd96528 req-ca1759b6-ffd6-43f2-b46f-b329f64d784d service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:41.532380 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.compute.server_external_events [req-1b8d8750-68c8-42b0-8a46-d3939cd96528 req-ca1759b6-ffd6-43f2-b46f-b329f64d784d service nova] Creating event network-vif-plugged:c9b7a4f8-5df1-449c-9157-130a564accea for instance 5610f3fc-4e8b-48c0-a628-4b5c9419635a on hv-cinder-85054 Jul 21 20:11:41.532620 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-4766e7f4-a446-4947-a314-b4711e4808bb tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:41.533234 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-4766e7f4-a446-4947-a314-b4711e4808bb tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: 5610f3fc-4e8b-48c0-a628-4b5c9419635a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:41.538200 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [req-1b8d8750-68c8-42b0-8a46-d3939cd96528 req-ca1759b6-ffd6-43f2-b46f-b329f64d784d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029964 Jul 21 20:11:41.539067 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 334/689] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 20:11:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:11:41.546466 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4766e7f4-a446-4947-a314-b4711e4808bb tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:41.546466 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4766e7f4-a446-4947-a314-b4711e4808bb tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:41.546466 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4766e7f4-a446-4947-a314-b4711e4808bb tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:41.546466 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4766e7f4-a446-4947-a314-b4711e4808bb tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:41.756996 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-4766e7f4-a446-4947-a314-b4711e4808bb tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:41.765362 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-4766e7f4-a446-4947-a314-b4711e4808bb tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:41.766989 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-4766e7f4-a446-4947-a314-b4711e4808bb tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:41.768310 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-4766e7f4-a446-4947-a314-b4711e4808bb tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a" status: 200 len: 1408 microversion: 2.20 time: 0.240247 Jul 21 20:11:41.768938 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 356/690] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:11:41 2022] GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a => generated 1408 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 20:11:41.828555 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-ae469922-5871-4f8c-8f5a-dc7c8302458a tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:41.829249 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-ae469922-5871-4f8c-8f5a-dc7c8302458a tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] [instance: 301ed3ad-5cb4-4ebf-ac32-519ab482cdea] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:41.835901 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-ae469922-5871-4f8c-8f5a-dc7c8302458a tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:41.836341 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-ae469922-5871-4f8c-8f5a-dc7c8302458a tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:41.837096 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-ae469922-5871-4f8c-8f5a-dc7c8302458a tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:41.837527 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-ae469922-5871-4f8c-8f5a-dc7c8302458a tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:41.970977 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-ae469922-5871-4f8c-8f5a-dc7c8302458a tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf78e0fe86d4e078c0527248af45cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4239f4ae39bb49cf8063377a93875456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:41.979305 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-ae469922-5871-4f8c-8f5a-dc7c8302458a tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] 10.222.0.58 "GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea" status: 200 len: 1568 microversion: 2.1 time: 0.154287 Jul 21 20:11:41.979890 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 335/691] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:11:41 2022] GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:11:42.419150 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [req-f51576a2-4fe2-4152-99ae-1dc651f7883d req-67a00bf2-c825-48b2-99f6-e251215d5389 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a41559e0-1fb6-44ef-97c1-36025e52fc48", "tag": "5adf0c2c-829c-455c-8756-df9cea6504d6"}]} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:11:42.429310 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-f51576a2-4fe2-4152-99ae-1dc651f7883d req-67a00bf2-c825-48b2-99f6-e251215d5389 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:42.429962 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-f51576a2-4fe2-4152-99ae-1dc651f7883d req-67a00bf2-c825-48b2-99f6-e251215d5389 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:42.442341 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.compute.server_external_events [req-f51576a2-4fe2-4152-99ae-1dc651f7883d req-67a00bf2-c825-48b2-99f6-e251215d5389 service nova] Creating event network-changed:5adf0c2c-829c-455c-8756-df9cea6504d6 for instance a41559e0-1fb6-44ef-97c1-36025e52fc48 on hv-cinder-85054 Jul 21 20:11:42.451674 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [req-f51576a2-4fe2-4152-99ae-1dc651f7883d req-67a00bf2-c825-48b2-99f6-e251215d5389 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036443 Jul 21 20:11:42.452508 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 357/692] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 20:11:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:11:42.785713 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-e7021740-9039-4665-b121-f7973ee54e92 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:42.787556 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-e7021740-9039-4665-b121-f7973ee54e92 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: 5610f3fc-4e8b-48c0-a628-4b5c9419635a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:42.794604 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-e7021740-9039-4665-b121-f7973ee54e92 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:42.795084 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-e7021740-9039-4665-b121-f7973ee54e92 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:42.795925 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-e7021740-9039-4665-b121-f7973ee54e92 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:42.796361 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-e7021740-9039-4665-b121-f7973ee54e92 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:42.928484 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-e7021740-9039-4665-b121-f7973ee54e92 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:42.936352 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-e7021740-9039-4665-b121-f7973ee54e92 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:42.937858 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-e7021740-9039-4665-b121-f7973ee54e92 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:42.938968 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-e7021740-9039-4665-b121-f7973ee54e92 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a" status: 200 len: 1408 microversion: 2.20 time: 0.157225 Jul 21 20:11:42.939560 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 336/693] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:11:42 2022] GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a => generated 1408 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:11:42.997111 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-1f668aee-e438-4d9e-857a-38f9e58781ef tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:42.997968 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-1f668aee-e438-4d9e-857a-38f9e58781ef tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] [instance: 301ed3ad-5cb4-4ebf-ac32-519ab482cdea] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:43.004194 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1f668aee-e438-4d9e-857a-38f9e58781ef tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:43.004716 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1f668aee-e438-4d9e-857a-38f9e58781ef tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:43.006064 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1f668aee-e438-4d9e-857a-38f9e58781ef tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:43.006575 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1f668aee-e438-4d9e-857a-38f9e58781ef tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:43.142450 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-1f668aee-e438-4d9e-857a-38f9e58781ef tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf78e0fe86d4e078c0527248af45cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4239f4ae39bb49cf8063377a93875456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:43.150653 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-1f668aee-e438-4d9e-857a-38f9e58781ef tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] 10.222.0.58 "GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea" status: 200 len: 1568 microversion: 2.1 time: 0.157831 Jul 21 20:11:43.151278 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 358/694] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:11:42 2022] GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:11:43.957564 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-ce2477fa-f79a-4a3b-beaf-9742127af1c5 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:43.958102 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-ce2477fa-f79a-4a3b-beaf-9742127af1c5 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: 5610f3fc-4e8b-48c0-a628-4b5c9419635a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:43.965137 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-ce2477fa-f79a-4a3b-beaf-9742127af1c5 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:43.965587 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-ce2477fa-f79a-4a3b-beaf-9742127af1c5 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:43.966356 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-ce2477fa-f79a-4a3b-beaf-9742127af1c5 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:43.966820 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-ce2477fa-f79a-4a3b-beaf-9742127af1c5 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:44.092830 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-ce2477fa-f79a-4a3b-beaf-9742127af1c5 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:44.101532 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-ce2477fa-f79a-4a3b-beaf-9742127af1c5 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:44.103055 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-ce2477fa-f79a-4a3b-beaf-9742127af1c5 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:44.104205 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-ce2477fa-f79a-4a3b-beaf-9742127af1c5 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a" status: 200 len: 1599 microversion: 2.20 time: 0.150795 Jul 21 20:11:44.104763 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 337/695] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:11:43 2022] GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a => generated 1599 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:11:44.121280 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-e0799679-fcc9-4188-82f7-7c4a6ba4b963 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:44.121818 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-e0799679-fcc9-4188-82f7-7c4a6ba4b963 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: 5610f3fc-4e8b-48c0-a628-4b5c9419635a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:44.127666 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e0799679-fcc9-4188-82f7-7c4a6ba4b963 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:44.128173 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e0799679-fcc9-4188-82f7-7c4a6ba4b963 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:44.128960 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e0799679-fcc9-4188-82f7-7c4a6ba4b963 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:44.129376 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e0799679-fcc9-4188-82f7-7c4a6ba4b963 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:44.168166 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-d255d636-d93d-4d81-950e-25d4e086a04d tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:44.168768 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-d255d636-d93d-4d81-950e-25d4e086a04d tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] [instance: 301ed3ad-5cb4-4ebf-ac32-519ab482cdea] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:44.174823 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-d255d636-d93d-4d81-950e-25d4e086a04d tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:44.175293 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-d255d636-d93d-4d81-950e-25d4e086a04d tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:44.176051 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-d255d636-d93d-4d81-950e-25d4e086a04d tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:44.176477 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-d255d636-d93d-4d81-950e-25d4e086a04d tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:44.209668 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-e0799679-fcc9-4188-82f7-7c4a6ba4b963 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.092149 Jul 21 20:11:44.210191 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 359/696] 10.222.0.58 () {60 vars in 1315 bytes} [Thu Jul 21 20:11:44 2022] GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 20:11:44.308181 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-047fcc5c-4569-408f-a8c0-cab8b642dcfb tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:44.308671 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-047fcc5c-4569-408f-a8c0-cab8b642dcfb tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:44.315632 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-047fcc5c-4569-408f-a8c0-cab8b642dcfb tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:44.318307 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-047fcc5c-4569-408f-a8c0-cab8b642dcfb tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:44.318307 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-047fcc5c-4569-408f-a8c0-cab8b642dcfb tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:44.318307 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-047fcc5c-4569-408f-a8c0-cab8b642dcfb tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:44.329332 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-d255d636-d93d-4d81-950e-25d4e086a04d tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf78e0fe86d4e078c0527248af45cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4239f4ae39bb49cf8063377a93875456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:44.340598 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-d255d636-d93d-4d81-950e-25d4e086a04d tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] 10.222.0.58 "GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea" status: 200 len: 1568 microversion: 2.1 time: 0.176102 Jul 21 20:11:44.341332 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 338/697] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:11:44 2022] GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea => generated 1568 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:11:44.407121 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.objects.instance [None req-047fcc5c-4569-408f-a8c0-cab8b642dcfb tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lazy-loading 'services' on Instance uuid 5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6 {{(pid=118345) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 20:11:44.631900 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-047fcc5c-4569-408f-a8c0-cab8b642dcfb tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "DELETE /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6/os-volume_attachments/400c7887-41b9-42a0-9afe-6c254423acb6" status: 202 len: 0 microversion: 2.1 time: 0.327639 Jul 21 20:11:44.632588 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 360/698] 10.222.0.58 () {58 vars in 1415 bytes} [Thu Jul 21 20:11:44 2022] DELETE /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6/os-volume_attachments/400c7887-41b9-42a0-9afe-6c254423acb6 => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 21 20:11:44.648922 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-1a9c1da5-54d7-4cbd-bd6d-d3e75bdf70e2 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:44.650012 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-1a9c1da5-54d7-4cbd-bd6d-d3e75bdf70e2 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:44.656060 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-1a9c1da5-54d7-4cbd-bd6d-d3e75bdf70e2 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:44.656523 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-1a9c1da5-54d7-4cbd-bd6d-d3e75bdf70e2 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:44.657338 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-1a9c1da5-54d7-4cbd-bd6d-d3e75bdf70e2 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:44.657774 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-1a9c1da5-54d7-4cbd-bd6d-d3e75bdf70e2 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:44.687327 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-1a9c1da5-54d7-4cbd-bd6d-d3e75bdf70e2 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050044 Jul 21 20:11:44.688122 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 339/699] 10.222.0.58 () {58 vars in 1301 bytes} [Thu Jul 21 20:11:44 2022] GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:11:45.360317 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-a59dc402-4d92-4f41-81e8-bad5818c3fbd tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:45.361018 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-a59dc402-4d92-4f41-81e8-bad5818c3fbd tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] [instance: 301ed3ad-5cb4-4ebf-ac32-519ab482cdea] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:45.367947 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a59dc402-4d92-4f41-81e8-bad5818c3fbd tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:45.368394 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a59dc402-4d92-4f41-81e8-bad5818c3fbd tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:45.369161 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a59dc402-4d92-4f41-81e8-bad5818c3fbd tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:45.369601 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a59dc402-4d92-4f41-81e8-bad5818c3fbd tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:45.511594 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-a59dc402-4d92-4f41-81e8-bad5818c3fbd tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf78e0fe86d4e078c0527248af45cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4239f4ae39bb49cf8063377a93875456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:45.519216 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-a59dc402-4d92-4f41-81e8-bad5818c3fbd tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] 10.222.0.58 "GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea" status: 200 len: 1568 microversion: 2.1 time: 0.163454 Jul 21 20:11:45.519785 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 361/700] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:11:45 2022] GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:11:45.700124 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-e871bf46-2790-49a1-8ca3-2d09b5ce1004 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:45.701273 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-e871bf46-2790-49a1-8ca3-2d09b5ce1004 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:45.707798 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-e871bf46-2790-49a1-8ca3-2d09b5ce1004 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:45.708811 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-e871bf46-2790-49a1-8ca3-2d09b5ce1004 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:45.709645 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-e871bf46-2790-49a1-8ca3-2d09b5ce1004 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:45.710149 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-e871bf46-2790-49a1-8ca3-2d09b5ce1004 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:45.739293 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-e871bf46-2790-49a1-8ca3-2d09b5ce1004 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043109 Jul 21 20:11:45.739900 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 340/701] 10.222.0.58 () {58 vars in 1301 bytes} [Thu Jul 21 20:11:45 2022] GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:11:45.966852 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [req-d6a1d082-b14f-46cd-990e-92c8adc59397 req-467ddb1f-e544-46b4-984b-916036dda30b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5610f3fc-4e8b-48c0-a628-4b5c9419635a", "tag": "c9b7a4f8-5df1-449c-9157-130a564accea"}]} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:11:45.975279 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-d6a1d082-b14f-46cd-990e-92c8adc59397 req-467ddb1f-e544-46b4-984b-916036dda30b service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:45.975841 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-d6a1d082-b14f-46cd-990e-92c8adc59397 req-467ddb1f-e544-46b4-984b-916036dda30b service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:45.986807 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.compute.server_external_events [req-d6a1d082-b14f-46cd-990e-92c8adc59397 req-467ddb1f-e544-46b4-984b-916036dda30b service nova] Creating event network-changed:c9b7a4f8-5df1-449c-9157-130a564accea for instance 5610f3fc-4e8b-48c0-a628-4b5c9419635a on hv-cinder-85054 Jul 21 20:11:45.991709 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [req-d6a1d082-b14f-46cd-990e-92c8adc59397 req-467ddb1f-e544-46b4-984b-916036dda30b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028713 Jul 21 20:11:45.992299 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 362/702] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 20:11:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:11:46.537140 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-7851ca18-5dad-4bc5-8520-e879dc8f070c tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:46.537667 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-7851ca18-5dad-4bc5-8520-e879dc8f070c tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] [instance: 301ed3ad-5cb4-4ebf-ac32-519ab482cdea] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:46.543786 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-7851ca18-5dad-4bc5-8520-e879dc8f070c tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:46.544237 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-7851ca18-5dad-4bc5-8520-e879dc8f070c tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:46.545003 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-7851ca18-5dad-4bc5-8520-e879dc8f070c tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:46.545439 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-7851ca18-5dad-4bc5-8520-e879dc8f070c tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:46.687438 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-7851ca18-5dad-4bc5-8520-e879dc8f070c tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf78e0fe86d4e078c0527248af45cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4239f4ae39bb49cf8063377a93875456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:46.698202 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-7851ca18-5dad-4bc5-8520-e879dc8f070c tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] 10.222.0.58 "GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea" status: 200 len: 1568 microversion: 2.1 time: 0.164974 Jul 21 20:11:46.698832 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 341/703] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:11:46 2022] GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:11:46.752493 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-6103af1b-8717-4d52-8170-22ad6b157c1d tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:46.754223 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-6103af1b-8717-4d52-8170-22ad6b157c1d tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:46.760860 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6103af1b-8717-4d52-8170-22ad6b157c1d tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:46.761679 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6103af1b-8717-4d52-8170-22ad6b157c1d tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:46.762729 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6103af1b-8717-4d52-8170-22ad6b157c1d tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:46.763478 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6103af1b-8717-4d52-8170-22ad6b157c1d tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:46.796530 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-6103af1b-8717-4d52-8170-22ad6b157c1d tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048928 Jul 21 20:11:46.797362 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 363/704] 10.222.0.58 () {58 vars in 1301 bytes} [Thu Jul 21 20:11:46 2022] GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:11:47.715594 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-97e166ee-7246-4794-89bb-7e689b1e2d0d tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:47.716247 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-97e166ee-7246-4794-89bb-7e689b1e2d0d tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] [instance: 301ed3ad-5cb4-4ebf-ac32-519ab482cdea] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:47.722971 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-97e166ee-7246-4794-89bb-7e689b1e2d0d tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:47.723443 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-97e166ee-7246-4794-89bb-7e689b1e2d0d tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:47.724196 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-97e166ee-7246-4794-89bb-7e689b1e2d0d tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:47.724630 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-97e166ee-7246-4794-89bb-7e689b1e2d0d tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:47.808651 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-92c8cb06-bbe7-47e4-8438-518975f5de98 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:47.809683 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-92c8cb06-bbe7-47e4-8438-518975f5de98 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:47.815772 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-92c8cb06-bbe7-47e4-8438-518975f5de98 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:47.820565 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-92c8cb06-bbe7-47e4-8438-518975f5de98 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:47.820565 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-92c8cb06-bbe7-47e4-8438-518975f5de98 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:47.820565 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-92c8cb06-bbe7-47e4-8438-518975f5de98 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:47.846643 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-92c8cb06-bbe7-47e4-8438-518975f5de98 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042324 Jul 21 20:11:47.847232 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 364/705] 10.222.0.58 () {58 vars in 1301 bytes} [Thu Jul 21 20:11:47 2022] GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 21 20:11:47.860492 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-97e166ee-7246-4794-89bb-7e689b1e2d0d tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf78e0fe86d4e078c0527248af45cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4239f4ae39bb49cf8063377a93875456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:47.870515 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-97e166ee-7246-4794-89bb-7e689b1e2d0d tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] 10.222.0.58 "GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea" status: 200 len: 1568 microversion: 2.1 time: 0.158705 Jul 21 20:11:47.882956 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 342/706] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:11:47 2022] GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:11:47.930001 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-536ec53b-128b-4187-ac1d-e05e112cccd2 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:47.930001 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-536ec53b-128b-4187-ac1d-e05e112cccd2 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:47.932722 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-536ec53b-128b-4187-ac1d-e05e112cccd2 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:47.933160 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-536ec53b-128b-4187-ac1d-e05e112cccd2 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:47.933939 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-536ec53b-128b-4187-ac1d-e05e112cccd2 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:47.934367 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-536ec53b-128b-4187-ac1d-e05e112cccd2 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:47.958752 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-536ec53b-128b-4187-ac1d-e05e112cccd2 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6] Going to try to terminate instance {{(pid=118345) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 20:11:47.961484 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:11:48.365474 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-536ec53b-128b-4187-ac1d-e05e112cccd2 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "DELETE /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6" status: 204 len: 0 microversion: 2.1 time: 0.442737 Jul 21 20:11:48.366069 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 365/707] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Jul 21 20:11:47 2022] DELETE /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 20:11:48.374083 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-579b0fb9-c398-459a-b9c2-432edf69d0eb tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:48.374693 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-579b0fb9-c398-459a-b9c2-432edf69d0eb tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:48.380753 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-579b0fb9-c398-459a-b9c2-432edf69d0eb tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:48.381192 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-579b0fb9-c398-459a-b9c2-432edf69d0eb tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:48.381947 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-579b0fb9-c398-459a-b9c2-432edf69d0eb tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:48.382380 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-579b0fb9-c398-459a-b9c2-432edf69d0eb tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:48.518232 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-579b0fb9-c398-459a-b9c2-432edf69d0eb tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:48.526160 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-579b0fb9-c398-459a-b9c2-432edf69d0eb tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6" status: 200 len: 1691 microversion: 2.1 time: 0.155930 Jul 21 20:11:48.526722 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 343/708] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:11:48 2022] GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6 => generated 1691 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:11:48.894242 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-7bde2caa-168d-4c3d-be88-b90d1115d57a tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:48.894974 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-7bde2caa-168d-4c3d-be88-b90d1115d57a tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] [instance: 301ed3ad-5cb4-4ebf-ac32-519ab482cdea] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:48.901712 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-7bde2caa-168d-4c3d-be88-b90d1115d57a tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:48.902084 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-7bde2caa-168d-4c3d-be88-b90d1115d57a tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:48.902828 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-7bde2caa-168d-4c3d-be88-b90d1115d57a tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:48.903281 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-7bde2caa-168d-4c3d-be88-b90d1115d57a tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:49.036007 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-7bde2caa-168d-4c3d-be88-b90d1115d57a tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf78e0fe86d4e078c0527248af45cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4239f4ae39bb49cf8063377a93875456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:49.043491 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-7bde2caa-168d-4c3d-be88-b90d1115d57a tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] 10.222.0.58 "GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea" status: 200 len: 1569 microversion: 2.1 time: 0.153505 Jul 21 20:11:49.044044 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 366/709] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:11:48 2022] GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:11:49.059505 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-ba13610d-9949-4774-aa1d-86765c424c52 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:11:49.060107 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-ba13610d-9949-4774-aa1d-86765c424c52 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] [instance: 301ed3ad-5cb4-4ebf-ac32-519ab482cdea] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:49.066496 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-ba13610d-9949-4774-aa1d-86765c424c52 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:49.066955 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-ba13610d-9949-4774-aa1d-86765c424c52 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:49.068260 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-ba13610d-9949-4774-aa1d-86765c424c52 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:49.068683 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-ba13610d-9949-4774-aa1d-86765c424c52 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:49.120390 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG dbcounter [-] [118344] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=118344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:11:49.328487 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-ba13610d-9949-4774-aa1d-86765c424c52 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] 10.222.0.58 "POST /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea/action" status: 202 len: 0 microversion: 2.1 time: 0.272493 Jul 21 20:11:49.329034 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 344/710] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Jul 21 20:11:49 2022] POST /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea/action => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 20:11:49.337252 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-19d31a34-37fa-4ad5-87a0-f2c0032e85f6 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:49.337857 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-19d31a34-37fa-4ad5-87a0-f2c0032e85f6 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] [instance: 301ed3ad-5cb4-4ebf-ac32-519ab482cdea] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:49.343844 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-19d31a34-37fa-4ad5-87a0-f2c0032e85f6 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:49.344279 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-19d31a34-37fa-4ad5-87a0-f2c0032e85f6 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:49.345034 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-19d31a34-37fa-4ad5-87a0-f2c0032e85f6 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:49.345459 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-19d31a34-37fa-4ad5-87a0-f2c0032e85f6 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:49.476763 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-19d31a34-37fa-4ad5-87a0-f2c0032e85f6 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf78e0fe86d4e078c0527248af45cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4239f4ae39bb49cf8063377a93875456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:49.484697 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-19d31a34-37fa-4ad5-87a0-f2c0032e85f6 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] 10.222.0.58 "GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea" status: 200 len: 1577 microversion: 2.1 time: 0.151274 Jul 21 20:11:49.485267 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 367/711] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:11:49 2022] GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea => generated 1577 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:11:49.542537 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-7e61cfd4-1c73-4e51-96fd-c117088a8d6f tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:49.543220 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-7e61cfd4-1c73-4e51-96fd-c117088a8d6f tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:49.549560 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-7e61cfd4-1c73-4e51-96fd-c117088a8d6f tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:49.550029 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-7e61cfd4-1c73-4e51-96fd-c117088a8d6f tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:49.550800 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-7e61cfd4-1c73-4e51-96fd-c117088a8d6f tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:49.551531 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-7e61cfd4-1c73-4e51-96fd-c117088a8d6f tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:49.684764 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-7e61cfd4-1c73-4e51-96fd-c117088a8d6f tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:49.692322 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-7e61cfd4-1c73-4e51-96fd-c117088a8d6f tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6" status: 200 len: 1691 microversion: 2.1 time: 0.153789 Jul 21 20:11:49.692972 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 345/712] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:11:49 2022] GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6 => generated 1691 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:11:50.502951 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-82555928-bcd0-4620-849d-0ab83b9ef794 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:50.503534 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-82555928-bcd0-4620-849d-0ab83b9ef794 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] [instance: 301ed3ad-5cb4-4ebf-ac32-519ab482cdea] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:50.509948 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-82555928-bcd0-4620-849d-0ab83b9ef794 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:50.510389 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-82555928-bcd0-4620-849d-0ab83b9ef794 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:50.512851 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-82555928-bcd0-4620-849d-0ab83b9ef794 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:50.512851 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-82555928-bcd0-4620-849d-0ab83b9ef794 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:50.640794 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-82555928-bcd0-4620-849d-0ab83b9ef794 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf78e0fe86d4e078c0527248af45cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4239f4ae39bb49cf8063377a93875456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:50.649169 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-82555928-bcd0-4620-849d-0ab83b9ef794 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] 10.222.0.58 "GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea" status: 200 len: 1577 microversion: 2.1 time: 0.150216 Jul 21 20:11:50.649736 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 368/713] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:11:50 2022] GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea => generated 1577 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:11:50.709388 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-d63e3448-70cc-4d8a-81ae-b5c7142444eb tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:50.709998 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-d63e3448-70cc-4d8a-81ae-b5c7142444eb tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:50.716434 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-d63e3448-70cc-4d8a-81ae-b5c7142444eb tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:50.716877 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-d63e3448-70cc-4d8a-81ae-b5c7142444eb tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:50.717634 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-d63e3448-70cc-4d8a-81ae-b5c7142444eb tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:50.718064 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-d63e3448-70cc-4d8a-81ae-b5c7142444eb tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:50.848426 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-d63e3448-70cc-4d8a-81ae-b5c7142444eb tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:50.855896 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-d63e3448-70cc-4d8a-81ae-b5c7142444eb tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6" status: 200 len: 1691 microversion: 2.1 time: 0.150893 Jul 21 20:11:50.856464 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 346/714] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:11:50 2022] GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6 => generated 1691 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:11:51.368863 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [req-c1c94b6f-43e7-4470-a102-cfeb97e46298 req-e0cec44a-76af-4a20-b61b-e7d9d25f06be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "301ed3ad-5cb4-4ebf-ac32-519ab482cdea", "name": "network-vif-unplugged", "status": "completed", "tag": "4300c7df-3693-4c3f-ae64-d9d267e9d57d"}]} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:11:51.376968 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-c1c94b6f-43e7-4470-a102-cfeb97e46298 req-e0cec44a-76af-4a20-b61b-e7d9d25f06be service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:51.377404 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-c1c94b6f-43e7-4470-a102-cfeb97e46298 req-e0cec44a-76af-4a20-b61b-e7d9d25f06be service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:51.388424 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.compute.server_external_events [req-c1c94b6f-43e7-4470-a102-cfeb97e46298 req-e0cec44a-76af-4a20-b61b-e7d9d25f06be service nova] Creating event network-vif-unplugged:4300c7df-3693-4c3f-ae64-d9d267e9d57d for instance 301ed3ad-5cb4-4ebf-ac32-519ab482cdea on hv-cinder-85054 Jul 21 20:11:51.393406 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [req-c1c94b6f-43e7-4470-a102-cfeb97e46298 req-e0cec44a-76af-4a20-b61b-e7d9d25f06be service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028885 Jul 21 20:11:51.393973 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 369/715] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 20:11:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:11:51.666978 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-4f2b32ef-0716-476c-a609-2d8b77f6176a tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:51.667608 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-4f2b32ef-0716-476c-a609-2d8b77f6176a tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] [instance: 301ed3ad-5cb4-4ebf-ac32-519ab482cdea] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:51.673575 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-4f2b32ef-0716-476c-a609-2d8b77f6176a tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:51.674018 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-4f2b32ef-0716-476c-a609-2d8b77f6176a tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:51.674774 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-4f2b32ef-0716-476c-a609-2d8b77f6176a tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:51.675242 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-4f2b32ef-0716-476c-a609-2d8b77f6176a tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:51.802952 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-4f2b32ef-0716-476c-a609-2d8b77f6176a tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf78e0fe86d4e078c0527248af45cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4239f4ae39bb49cf8063377a93875456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:51.810460 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-4f2b32ef-0716-476c-a609-2d8b77f6176a tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] 10.222.0.58 "GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea" status: 200 len: 1577 microversion: 2.1 time: 0.147387 Jul 21 20:11:51.811049 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 347/716] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:11:51 2022] GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea => generated 1577 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:11:51.873653 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-13fc7d18-6a92-4fa7-a39c-539bd7e2ea5e tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:51.874352 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-13fc7d18-6a92-4fa7-a39c-539bd7e2ea5e tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:51.881020 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-13fc7d18-6a92-4fa7-a39c-539bd7e2ea5e tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:51.881464 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-13fc7d18-6a92-4fa7-a39c-539bd7e2ea5e tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:51.882222 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-13fc7d18-6a92-4fa7-a39c-539bd7e2ea5e tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:51.882654 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-13fc7d18-6a92-4fa7-a39c-539bd7e2ea5e tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:52.011520 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-13fc7d18-6a92-4fa7-a39c-539bd7e2ea5e tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:52.020357 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-13fc7d18-6a92-4fa7-a39c-539bd7e2ea5e tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6" status: 200 len: 1691 microversion: 2.1 time: 0.150662 Jul 21 20:11:52.022445 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 370/717] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:11:51 2022] GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6 => generated 1691 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:11:52.827657 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-08a2b16c-a2cd-46ba-9176-d5f6b6b6b397 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:52.829332 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-08a2b16c-a2cd-46ba-9176-d5f6b6b6b397 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] [instance: 301ed3ad-5cb4-4ebf-ac32-519ab482cdea] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:52.836214 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-08a2b16c-a2cd-46ba-9176-d5f6b6b6b397 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:52.836724 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-08a2b16c-a2cd-46ba-9176-d5f6b6b6b397 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:52.837565 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-08a2b16c-a2cd-46ba-9176-d5f6b6b6b397 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:52.838134 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-08a2b16c-a2cd-46ba-9176-d5f6b6b6b397 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:52.978886 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-08a2b16c-a2cd-46ba-9176-d5f6b6b6b397 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf78e0fe86d4e078c0527248af45cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4239f4ae39bb49cf8063377a93875456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:52.987071 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-08a2b16c-a2cd-46ba-9176-d5f6b6b6b397 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] 10.222.0.58 "GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea" status: 200 len: 1519 microversion: 2.1 time: 0.163312 Jul 21 20:11:52.987743 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 348/718] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:11:52 2022] GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea => generated 1519 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:11:53.038330 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-1f94067b-4fc7-49c8-9772-4ce46fef1756 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:53.038934 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-1f94067b-4fc7-49c8-9772-4ce46fef1756 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:53.045010 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1f94067b-4fc7-49c8-9772-4ce46fef1756 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:53.045457 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1f94067b-4fc7-49c8-9772-4ce46fef1756 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:53.046213 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1f94067b-4fc7-49c8-9772-4ce46fef1756 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:53.046645 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1f94067b-4fc7-49c8-9772-4ce46fef1756 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:53.375981 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-1f94067b-4fc7-49c8-9772-4ce46fef1756 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:53.383899 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-1f94067b-4fc7-49c8-9772-4ce46fef1756 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6" status: 200 len: 1691 microversion: 2.1 time: 0.350153 Jul 21 20:11:53.384461 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 371/719] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:11:53 2022] GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6 => generated 1691 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:11:53.872736 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [req-362150be-8bf9-4966-b867-f517f65fbbf5 req-d440b056-a9c1-4bcf-93ce-1c075a62c65b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6", "name": "network-vif-deleted", "tag": "2c53b026-bf56-4c64-b42c-bad40f216602"}]} {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:11:53.889744 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [req-362150be-8bf9-4966-b867-f517f65fbbf5 req-d440b056-a9c1-4bcf-93ce-1c075a62c65b service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:53.890189 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [req-362150be-8bf9-4966-b867-f517f65fbbf5 req-d440b056-a9c1-4bcf-93ce-1c075a62c65b service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:53.902157 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.compute.server_external_events [req-362150be-8bf9-4966-b867-f517f65fbbf5 req-d440b056-a9c1-4bcf-93ce-1c075a62c65b service nova] Creating event network-vif-deleted:2c53b026-bf56-4c64-b42c-bad40f216602 for instance 5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6 on hv-cinder-85054 Jul 21 20:11:53.908075 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [req-362150be-8bf9-4966-b867-f517f65fbbf5 req-d440b056-a9c1-4bcf-93ce-1c075a62c65b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038956 Jul 21 20:11:53.908689 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 349/720] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 20:11:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:11:54.007407 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-a74f1889-0e3a-4137-a692-afa91cb77ff2 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:54.010217 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-a74f1889-0e3a-4137-a692-afa91cb77ff2 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] [instance: 301ed3ad-5cb4-4ebf-ac32-519ab482cdea] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:54.015393 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a74f1889-0e3a-4137-a692-afa91cb77ff2 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:54.015847 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a74f1889-0e3a-4137-a692-afa91cb77ff2 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:54.016677 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a74f1889-0e3a-4137-a692-afa91cb77ff2 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:54.017126 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a74f1889-0e3a-4137-a692-afa91cb77ff2 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:54.185508 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-a74f1889-0e3a-4137-a692-afa91cb77ff2 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf78e0fe86d4e078c0527248af45cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4239f4ae39bb49cf8063377a93875456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:54.194156 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-a74f1889-0e3a-4137-a692-afa91cb77ff2 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] 10.222.0.58 "GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea" status: 200 len: 1519 microversion: 2.1 time: 0.191898 Jul 21 20:11:54.203577 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 372/721] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:11:54 2022] GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea => generated 1519 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:11:54.401319 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-ec4982d0-be58-41ac-bca2-baf63f3e1ffa tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:54.402012 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-ec4982d0-be58-41ac-bca2-baf63f3e1ffa tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:54.408288 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-ec4982d0-be58-41ac-bca2-baf63f3e1ffa tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:54.408731 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-ec4982d0-be58-41ac-bca2-baf63f3e1ffa tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:54.409494 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-ec4982d0-be58-41ac-bca2-baf63f3e1ffa tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:54.409915 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-ec4982d0-be58-41ac-bca2-baf63f3e1ffa tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:54.441601 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-ec4982d0-be58-41ac-bca2-baf63f3e1ffa tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:54.442039 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-ec4982d0-be58-41ac-bca2-baf63f3e1ffa tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:54.442485 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.objects.instance [None req-ec4982d0-be58-41ac-bca2-baf63f3e1ffa tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lazy-loading 'fault' on Instance uuid 5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6 {{(pid=118344) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 20:11:54.492679 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-ec4982d0-be58-41ac-bca2-baf63f3e1ffa tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:54.500282 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-ec4982d0-be58-41ac-bca2-baf63f3e1ffa tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6" status: 200 len: 1335 microversion: 2.1 time: 0.103182 Jul 21 20:11:54.501127 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 350/722] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:11:54 2022] GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6 => generated 1335 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:11:55.212661 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-f6c85e1f-14e2-4f43-b750-730f2b276de0 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:55.213264 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-f6c85e1f-14e2-4f43-b750-730f2b276de0 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] [instance: 301ed3ad-5cb4-4ebf-ac32-519ab482cdea] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:55.219702 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f6c85e1f-14e2-4f43-b750-730f2b276de0 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:55.220086 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f6c85e1f-14e2-4f43-b750-730f2b276de0 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:55.221143 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f6c85e1f-14e2-4f43-b750-730f2b276de0 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:55.221569 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f6c85e1f-14e2-4f43-b750-730f2b276de0 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:55.353856 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-f6c85e1f-14e2-4f43-b750-730f2b276de0 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf78e0fe86d4e078c0527248af45cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4239f4ae39bb49cf8063377a93875456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:55.361798 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-f6c85e1f-14e2-4f43-b750-730f2b276de0 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] 10.222.0.58 "GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea" status: 200 len: 1575 microversion: 2.1 time: 0.153664 Jul 21 20:11:55.362702 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 373/723] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:11:55 2022] GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:11:55.520557 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-e9d55578-2f25-4b0d-b196-0e87222903a1 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:55.521169 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-e9d55578-2f25-4b0d-b196-0e87222903a1 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:55.527608 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-e9d55578-2f25-4b0d-b196-0e87222903a1 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:55.528061 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-e9d55578-2f25-4b0d-b196-0e87222903a1 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:55.528824 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-e9d55578-2f25-4b0d-b196-0e87222903a1 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:55.529334 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-e9d55578-2f25-4b0d-b196-0e87222903a1 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:55.544620 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.wsgi [None req-e9d55578-2f25-4b0d-b196-0e87222903a1 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] HTTP exception thrown: Instance 5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6 could not be found. Jul 21 20:11:55.546264 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-e9d55578-2f25-4b0d-b196-0e87222903a1 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Request method failure captured: Jul 21 20:11:55.546264 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: request: GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6 HTTP/1.1 Jul 21 20:11:55.546264 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Accept: application/json Jul 21 20:11:55.546264 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Accept-Encoding: identity Jul 21 20:11:55.546264 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Connection: close Jul 21 20:11:55.546264 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Content-Length: 0 Jul 21 20:11:55.546264 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Content-Type: application/json Jul 21 20:11:55.546264 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Host: 10.222.0.58 Jul 21 20:11:55.546264 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Openstack-System-Scope: None Jul 21 20:11:55.546264 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: User-Agent: python-urllib3/1.26.9 Jul 21 20:11:55.546264 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Auth-Token: gAAAAABi2bFozFOmeFjCWltvy8VhOWCofqDkL3eFiDeXHKMTK5OfgvASsxAtL3iRYEdZZ7pOuKVQA34GMN_bqQ_UDkdmJ9edR5NJ1MVnnwiRBdlInNadgfKnNIDs7Z86jLqiTMWRcpjxhBqQIcTH49W1JEnUteXxWbRKxG7NWslugE8wtbbj48I Jul 21 20:11:55.546264 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Domain-Id: None Jul 21 20:11:55.546264 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Domain-Name: None Jul 21 20:11:55.546264 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Identity-Status: Confirmed Jul 21 20:11:55.546264 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Is-Admin-Project: True Jul 21 20:11:55.546264 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Domain-Id: default Jul 21 20:11:55.546264 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Domain-Name: Default Jul 21 20:11:55.546264 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Id: 6d4acf1287ad4dac9bbf6dc27f427a7c Jul 21 20:11:55.546264 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1971750390 Jul 21 20:11:55.546264 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Role: reader,member Jul 21 20:11:55.546264 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Roles: reader,member Jul 21 20:11:55.547805 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/6d4acf1287ad4dac9bbf6dc27f427a7c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6d4acf1287ad4dac9bbf6dc27f427a7c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_6d4acf1287ad4dac9bbf6dc27f427a7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6d4acf1287ad4dac9bbf6dc27f427a7c"}]}] Jul 21 20:11:55.547805 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1971750390 Jul 21 20:11:55.547805 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Tenant-Id: 6d4acf1287ad4dac9bbf6dc27f427a7c Jul 21 20:11:55.547805 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1971750390 Jul 21 20:11:55.547805 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User: tempest-ServerRescueNegativeTestJSON-1971750390-project Jul 21 20:11:55.547805 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Domain-Id: default Jul 21 20:11:55.547805 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Domain-Name: Default Jul 21 20:11:55.547805 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Id: df9139f72d004b2fac1cba17647c129d Jul 21 20:11:55.547805 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1971750390-project Jul 21 20:11:55.547805 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: method: > Jul 21 20:11:55.547805 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: exception: Instance 5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6 could not be found. Jul 21 20:11:55.547805 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: action_args: {'id': '5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6'} Jul 21 20:11:55.548677 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 20:11:55.548677 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:11:55.548677 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 20:11:55.548677 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 20:11:55.548677 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 20:11:55.548677 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 20:11:55.548677 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 20:11:55.548677 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 20:11:55.548677 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 20:11:55.548677 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 20:11:55.548677 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6 could not be found. Jul 21 20:11:55.548677 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:11:55.548677 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:11:55.548677 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:11:55.548677 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:11:55.548677 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:11:55.548677 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:11:55.548677 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 20:11:55.548677 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 20:11:55.548677 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 20:11:55.549851 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 20:11:55.549851 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 20:11:55.549851 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 20:11:55.549851 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 20:11:55.549851 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 20:11:55.549851 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 20:11:55.549851 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 20:11:55.549851 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6 could not be found. Jul 21 20:11:55.549851 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:11:55.549851 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:11:55.549851 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:11:55.549851 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:11:55.549851 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:11:55.549851 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:11:55.549851 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 20:11:55.549851 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 20:11:55.549851 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6 could not be found. Jul 21 20:11:55.549851 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:11:55.550957 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-e9d55578-2f25-4b0d-b196-0e87222903a1 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Returning 404 to user: Instance 5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6 could not be found. {{(pid=118344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 20:11:55.550957 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-e9d55578-2f25-4b0d-b196-0e87222903a1 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6" status: 404 len: 111 microversion: 2.1 time: 0.031108 Jul 21 20:11:55.550957 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 351/724] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:11:55 2022] GET /compute/v2.1/servers/5ef3e75c-9d0e-4dc0-ac7f-e629988de0a6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 20:11:55.559278 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-7a62bc31-8218-46bf-89f6-5bfeb8f8a54e tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '.version_select at 0x7f351cdfc310>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:55.613631 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-7a62bc31-8218-46bf-89f6-5bfeb8f8a54e tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1468934351" status: 202 len: 0 microversion: 2.1 time: 0.060075 Jul 21 20:11:55.614219 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 374/725] 10.222.0.58 () {58 vars in 1220 bytes} [Thu Jul 21 20:11:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1468934351 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 20:11:56.380872 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-997d47d6-00aa-4c80-994c-5500b0180ac0 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:56.381489 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-997d47d6-00aa-4c80-994c-5500b0180ac0 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] [instance: 301ed3ad-5cb4-4ebf-ac32-519ab482cdea] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:56.387571 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-997d47d6-00aa-4c80-994c-5500b0180ac0 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:56.389196 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-997d47d6-00aa-4c80-994c-5500b0180ac0 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:56.389196 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-997d47d6-00aa-4c80-994c-5500b0180ac0 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:56.389472 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-997d47d6-00aa-4c80-994c-5500b0180ac0 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:56.543215 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-997d47d6-00aa-4c80-994c-5500b0180ac0 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf78e0fe86d4e078c0527248af45cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4239f4ae39bb49cf8063377a93875456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:56.555592 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-997d47d6-00aa-4c80-994c-5500b0180ac0 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] 10.222.0.58 "GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea" status: 200 len: 1575 microversion: 2.1 time: 0.175216 Jul 21 20:11:56.555592 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 352/726] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:11:56 2022] GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea => generated 1575 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:11:57.568795 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-8bb9d76c-b4d0-4544-9dda-8b96680b7088 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:57.569304 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-8bb9d76c-b4d0-4544-9dda-8b96680b7088 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] [instance: 301ed3ad-5cb4-4ebf-ac32-519ab482cdea] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:57.575565 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8bb9d76c-b4d0-4544-9dda-8b96680b7088 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:57.577067 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8bb9d76c-b4d0-4544-9dda-8b96680b7088 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:57.577067 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8bb9d76c-b4d0-4544-9dda-8b96680b7088 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:57.577246 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8bb9d76c-b4d0-4544-9dda-8b96680b7088 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:57.713443 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-8bb9d76c-b4d0-4544-9dda-8b96680b7088 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf78e0fe86d4e078c0527248af45cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4239f4ae39bb49cf8063377a93875456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:57.721387 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-8bb9d76c-b4d0-4544-9dda-8b96680b7088 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] 10.222.0.58 "GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea" status: 200 len: 1575 microversion: 2.1 time: 0.156519 Jul 21 20:11:57.721957 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 375/727] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:11:57 2022] GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:11:58.738993 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-4a7ce29b-0362-4000-98f4-4f04cb68ad54 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:58.739621 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-4a7ce29b-0362-4000-98f4-4f04cb68ad54 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] [instance: 301ed3ad-5cb4-4ebf-ac32-519ab482cdea] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:58.746223 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-4a7ce29b-0362-4000-98f4-4f04cb68ad54 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:58.746661 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-4a7ce29b-0362-4000-98f4-4f04cb68ad54 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:58.747454 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-4a7ce29b-0362-4000-98f4-4f04cb68ad54 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:58.747884 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-4a7ce29b-0362-4000-98f4-4f04cb68ad54 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:58.876737 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-4a7ce29b-0362-4000-98f4-4f04cb68ad54 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf78e0fe86d4e078c0527248af45cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4239f4ae39bb49cf8063377a93875456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:58.884821 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-4a7ce29b-0362-4000-98f4-4f04cb68ad54 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] 10.222.0.58 "GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea" status: 200 len: 1575 microversion: 2.1 time: 0.149669 Jul 21 20:11:58.885391 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 353/728] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:11:58 2022] GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea => generated 1575 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:11:58.938307 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-ad685030-6152-4e62-bac6-36dcfbe5aefc tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:58.938789 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-ad685030-6152-4e62-bac6-36dcfbe5aefc tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 514a7771-fbf2-46db-9e3d-905a6a3e703d] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:58.945342 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ad685030-6152-4e62-bac6-36dcfbe5aefc tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:58.945792 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ad685030-6152-4e62-bac6-36dcfbe5aefc tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:58.946558 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ad685030-6152-4e62-bac6-36dcfbe5aefc tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:58.946996 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ad685030-6152-4e62-bac6-36dcfbe5aefc tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:58.971608 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-ad685030-6152-4e62-bac6-36dcfbe5aefc tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 514a7771-fbf2-46db-9e3d-905a6a3e703d] Going to try to terminate instance {{(pid=118345) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 20:11:59.280695 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-ad685030-6152-4e62-bac6-36dcfbe5aefc tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "DELETE /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d" status: 204 len: 0 microversion: 2.1 time: 0.345942 Jul 21 20:11:59.281277 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 376/729] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Jul 21 20:11:58 2022] DELETE /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 20:11:59.289782 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-df7d03c0-4869-4b2c-8b64-022de9e8d16d tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:59.290391 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-df7d03c0-4869-4b2c-8b64-022de9e8d16d tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 514a7771-fbf2-46db-9e3d-905a6a3e703d] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:59.292875 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG dbcounter [-] [118344] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=79 {{(pid=118344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:11:59.297784 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-df7d03c0-4869-4b2c-8b64-022de9e8d16d tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:59.298227 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-df7d03c0-4869-4b2c-8b64-022de9e8d16d tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:59.298978 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-df7d03c0-4869-4b2c-8b64-022de9e8d16d tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:59.299432 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-df7d03c0-4869-4b2c-8b64-022de9e8d16d tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:59.431764 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-df7d03c0-4869-4b2c-8b64-022de9e8d16d tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:11:59.439166 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-df7d03c0-4869-4b2c-8b64-022de9e8d16d tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d" status: 200 len: 1507 microversion: 2.1 time: 0.153729 Jul 21 20:11:59.439736 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 354/730] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:11:59 2022] GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:11:59.901679 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-20a304bc-345d-4f3b-80af-4415b9e8ca5e tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:11:59.902358 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-20a304bc-345d-4f3b-80af-4415b9e8ca5e tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] [instance: 301ed3ad-5cb4-4ebf-ac32-519ab482cdea] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:11:59.908438 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-20a304bc-345d-4f3b-80af-4415b9e8ca5e tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:59.908878 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-20a304bc-345d-4f3b-80af-4415b9e8ca5e tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:11:59.909635 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-20a304bc-345d-4f3b-80af-4415b9e8ca5e tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:11:59.910066 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-20a304bc-345d-4f3b-80af-4415b9e8ca5e tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:12:00.043929 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-20a304bc-345d-4f3b-80af-4415b9e8ca5e tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf78e0fe86d4e078c0527248af45cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4239f4ae39bb49cf8063377a93875456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:12:00.051323 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-20a304bc-345d-4f3b-80af-4415b9e8ca5e tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] 10.222.0.58 "GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea" status: 200 len: 1575 microversion: 2.1 time: 0.153889 Jul 21 20:12:00.052387 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 377/731] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:11:59 2022] GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:12:00.456212 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-6c98ade7-f8a8-4a0e-898b-6eeed7b5205f tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:12:00.456815 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-6c98ade7-f8a8-4a0e-898b-6eeed7b5205f tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 514a7771-fbf2-46db-9e3d-905a6a3e703d] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:12:00.464034 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-6c98ade7-f8a8-4a0e-898b-6eeed7b5205f tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:12:00.464421 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-6c98ade7-f8a8-4a0e-898b-6eeed7b5205f tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:12:00.465179 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-6c98ade7-f8a8-4a0e-898b-6eeed7b5205f tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:12:00.465606 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-6c98ade7-f8a8-4a0e-898b-6eeed7b5205f tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:12:00.601593 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-6c98ade7-f8a8-4a0e-898b-6eeed7b5205f tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:12:00.609026 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-6c98ade7-f8a8-4a0e-898b-6eeed7b5205f tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d" status: 200 len: 1507 microversion: 2.1 time: 0.156661 Jul 21 20:12:00.610048 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 355/732] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:12:00 2022] GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:12:01.070245 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-aa161e8e-05e2-421c-a374-e2c6aa95292e tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:12:01.070640 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-aa161e8e-05e2-421c-a374-e2c6aa95292e tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] [instance: 301ed3ad-5cb4-4ebf-ac32-519ab482cdea] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:12:01.079196 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-aa161e8e-05e2-421c-a374-e2c6aa95292e tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:12:01.079708 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-aa161e8e-05e2-421c-a374-e2c6aa95292e tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:12:01.080496 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-aa161e8e-05e2-421c-a374-e2c6aa95292e tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:12:01.080932 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-aa161e8e-05e2-421c-a374-e2c6aa95292e tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:12:01.113288 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [req-d8354878-2c60-4e4a-ad53-d585a1330290 req-4967cf58-682f-4b12-99b9-41063e5034da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "514a7771-fbf2-46db-9e3d-905a6a3e703d", "name": "network-vif-deleted", "tag": "fbb80a34-19c6-45c1-858e-6d36cec0a5b8"}]} {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:12:01.121989 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [req-d8354878-2c60-4e4a-ad53-d585a1330290 req-4967cf58-682f-4b12-99b9-41063e5034da service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:12:01.122523 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [req-d8354878-2c60-4e4a-ad53-d585a1330290 req-4967cf58-682f-4b12-99b9-41063e5034da service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:12:01.135828 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.compute.server_external_events [req-d8354878-2c60-4e4a-ad53-d585a1330290 req-4967cf58-682f-4b12-99b9-41063e5034da service nova] Creating event network-vif-deleted:fbb80a34-19c6-45c1-858e-6d36cec0a5b8 for instance 514a7771-fbf2-46db-9e3d-905a6a3e703d on hv-cinder-85054 Jul 21 20:12:01.140018 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [req-d8354878-2c60-4e4a-ad53-d585a1330290 req-4967cf58-682f-4b12-99b9-41063e5034da service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030364 Jul 21 20:12:01.140795 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 356/733] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 20:12:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 20:12:01.238560 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-aa161e8e-05e2-421c-a374-e2c6aa95292e tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf78e0fe86d4e078c0527248af45cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4239f4ae39bb49cf8063377a93875456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:12:01.246718 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-aa161e8e-05e2-421c-a374-e2c6aa95292e tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] 10.222.0.58 "GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea" status: 200 len: 1575 microversion: 2.1 time: 0.181487 Jul 21 20:12:01.247325 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 378/734] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:12:01 2022] GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea => generated 1575 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:12:01.630059 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-d8b7fefc-c6c1-43b2-ae55-a5a4650afaa1 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:12:01.630674 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-d8b7fefc-c6c1-43b2-ae55-a5a4650afaa1 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 514a7771-fbf2-46db-9e3d-905a6a3e703d] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:12:01.636915 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-d8b7fefc-c6c1-43b2-ae55-a5a4650afaa1 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:12:01.637351 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-d8b7fefc-c6c1-43b2-ae55-a5a4650afaa1 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:12:01.638192 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-d8b7fefc-c6c1-43b2-ae55-a5a4650afaa1 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:12:01.638618 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-d8b7fefc-c6c1-43b2-ae55-a5a4650afaa1 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:12:01.668883 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-d8b7fefc-c6c1-43b2-ae55-a5a4650afaa1 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:12:01.669324 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-d8b7fefc-c6c1-43b2-ae55-a5a4650afaa1 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:12:01.669761 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.objects.instance [None req-d8b7fefc-c6c1-43b2-ae55-a5a4650afaa1 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lazy-loading 'fault' on Instance uuid 514a7771-fbf2-46db-9e3d-905a6a3e703d {{(pid=118344) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 20:12:01.710397 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-d8b7fefc-c6c1-43b2-ae55-a5a4650afaa1 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:12:01.717590 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-d8b7fefc-c6c1-43b2-ae55-a5a4650afaa1 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d" status: 200 len: 1311 microversion: 2.1 time: 0.092500 Jul 21 20:12:01.718146 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 357/735] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:12:01 2022] GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d => generated 1311 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:12:02.264342 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-0808ddab-cf06-4616-b98b-565dabc27459 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:12:02.264959 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-0808ddab-cf06-4616-b98b-565dabc27459 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] [instance: 301ed3ad-5cb4-4ebf-ac32-519ab482cdea] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:12:02.271521 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0808ddab-cf06-4616-b98b-565dabc27459 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:12:02.271962 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0808ddab-cf06-4616-b98b-565dabc27459 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:12:02.272720 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0808ddab-cf06-4616-b98b-565dabc27459 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:12:02.273149 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0808ddab-cf06-4616-b98b-565dabc27459 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:12:02.413123 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-0808ddab-cf06-4616-b98b-565dabc27459 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf78e0fe86d4e078c0527248af45cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4239f4ae39bb49cf8063377a93875456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:12:02.420798 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-0808ddab-cf06-4616-b98b-565dabc27459 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] 10.222.0.58 "GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea" status: 200 len: 1575 microversion: 2.1 time: 0.160363 Jul 21 20:12:02.421430 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 379/736] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:12:02 2022] GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:12:02.734569 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-50d2e6de-a87f-4213-bef9-43fa18c712f8 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:12:02.735226 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-50d2e6de-a87f-4213-bef9-43fa18c712f8 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 514a7771-fbf2-46db-9e3d-905a6a3e703d] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:12:02.741667 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-50d2e6de-a87f-4213-bef9-43fa18c712f8 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:12:02.742103 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-50d2e6de-a87f-4213-bef9-43fa18c712f8 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:12:02.742852 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-50d2e6de-a87f-4213-bef9-43fa18c712f8 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:12:02.743301 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-50d2e6de-a87f-4213-bef9-43fa18c712f8 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:12:02.758166 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.wsgi [None req-50d2e6de-a87f-4213-bef9-43fa18c712f8 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] HTTP exception thrown: Instance 514a7771-fbf2-46db-9e3d-905a6a3e703d could not be found. Jul 21 20:12:02.759790 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-50d2e6de-a87f-4213-bef9-43fa18c712f8 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Request method failure captured: Jul 21 20:12:02.759790 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: request: GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d HTTP/1.1 Jul 21 20:12:02.759790 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Accept: application/json Jul 21 20:12:02.759790 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Accept-Encoding: identity Jul 21 20:12:02.759790 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Connection: close Jul 21 20:12:02.759790 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Content-Length: 0 Jul 21 20:12:02.759790 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Content-Type: application/json Jul 21 20:12:02.759790 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Host: 10.222.0.58 Jul 21 20:12:02.759790 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Openstack-System-Scope: None Jul 21 20:12:02.759790 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: User-Agent: python-urllib3/1.26.9 Jul 21 20:12:02.759790 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Auth-Token: gAAAAABi2bFozFOmeFjCWltvy8VhOWCofqDkL3eFiDeXHKMTK5OfgvASsxAtL3iRYEdZZ7pOuKVQA34GMN_bqQ_UDkdmJ9edR5NJ1MVnnwiRBdlInNadgfKnNIDs7Z86jLqiTMWRcpjxhBqQIcTH49W1JEnUteXxWbRKxG7NWslugE8wtbbj48I Jul 21 20:12:02.759790 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Domain-Id: None Jul 21 20:12:02.759790 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Domain-Name: None Jul 21 20:12:02.759790 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Identity-Status: Confirmed Jul 21 20:12:02.759790 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Is-Admin-Project: True Jul 21 20:12:02.759790 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Domain-Id: default Jul 21 20:12:02.759790 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Domain-Name: Default Jul 21 20:12:02.759790 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Id: 6d4acf1287ad4dac9bbf6dc27f427a7c Jul 21 20:12:02.759790 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1971750390 Jul 21 20:12:02.759790 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Role: reader,member Jul 21 20:12:02.759790 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Roles: reader,member Jul 21 20:12:02.761228 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/6d4acf1287ad4dac9bbf6dc27f427a7c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6d4acf1287ad4dac9bbf6dc27f427a7c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_6d4acf1287ad4dac9bbf6dc27f427a7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6d4acf1287ad4dac9bbf6dc27f427a7c"}]}] Jul 21 20:12:02.761228 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1971750390 Jul 21 20:12:02.761228 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Tenant-Id: 6d4acf1287ad4dac9bbf6dc27f427a7c Jul 21 20:12:02.761228 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1971750390 Jul 21 20:12:02.761228 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User: tempest-ServerRescueNegativeTestJSON-1971750390-project Jul 21 20:12:02.761228 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Domain-Id: default Jul 21 20:12:02.761228 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Domain-Name: Default Jul 21 20:12:02.761228 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Id: df9139f72d004b2fac1cba17647c129d Jul 21 20:12:02.761228 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1971750390-project Jul 21 20:12:02.761228 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: method: > Jul 21 20:12:02.761228 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: exception: Instance 514a7771-fbf2-46db-9e3d-905a6a3e703d could not be found. Jul 21 20:12:02.761228 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: action_args: {'id': '514a7771-fbf2-46db-9e3d-905a6a3e703d'} Jul 21 20:12:02.762002 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 20:12:02.762002 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:12:02.762002 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 20:12:02.762002 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 20:12:02.762002 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 20:12:02.762002 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 20:12:02.762002 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 20:12:02.762002 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 20:12:02.762002 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 20:12:02.762002 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 20:12:02.762002 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 514a7771-fbf2-46db-9e3d-905a6a3e703d could not be found. Jul 21 20:12:02.762002 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:12:02.762002 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:12:02.762002 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:12:02.762002 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:12:02.762002 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:12:02.762002 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:12:02.762002 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 20:12:02.762002 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 20:12:02.762002 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 20:12:02.763547 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 20:12:02.763547 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 20:12:02.763547 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 20:12:02.763547 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 20:12:02.763547 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 20:12:02.763547 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 20:12:02.763547 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 20:12:02.763547 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 514a7771-fbf2-46db-9e3d-905a6a3e703d could not be found. Jul 21 20:12:02.763547 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:12:02.763547 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:12:02.763547 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:12:02.763547 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:12:02.763547 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:12:02.763547 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:12:02.763547 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 20:12:02.763547 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 20:12:02.763547 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 514a7771-fbf2-46db-9e3d-905a6a3e703d could not be found. Jul 21 20:12:02.763547 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:12:02.765088 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-50d2e6de-a87f-4213-bef9-43fa18c712f8 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Returning 404 to user: Instance 514a7771-fbf2-46db-9e3d-905a6a3e703d could not be found. {{(pid=118344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 20:12:02.765088 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-50d2e6de-a87f-4213-bef9-43fa18c712f8 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d" status: 404 len: 111 microversion: 2.1 time: 0.030485 Jul 21 20:12:02.765088 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 358/737] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:12:02 2022] GET /compute/v2.1/servers/514a7771-fbf2-46db-9e3d-905a6a3e703d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 20:12:02.769581 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-b9c735aa-36ec-4644-a864-50a2e2fc1db8 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:12:02.770082 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-b9c735aa-36ec-4644-a864-50a2e2fc1db8 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 3a615f10-936f-48d1-aad9-e414dc31d016] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:12:02.776575 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b9c735aa-36ec-4644-a864-50a2e2fc1db8 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:12:02.777022 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b9c735aa-36ec-4644-a864-50a2e2fc1db8 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:12:02.777781 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b9c735aa-36ec-4644-a864-50a2e2fc1db8 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:12:02.778215 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b9c735aa-36ec-4644-a864-50a2e2fc1db8 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:12:02.802938 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-b9c735aa-36ec-4644-a864-50a2e2fc1db8 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 3a615f10-936f-48d1-aad9-e414dc31d016] Going to try to terminate instance {{(pid=118345) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 20:12:02.805740 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:12:03.114481 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-b9c735aa-36ec-4644-a864-50a2e2fc1db8 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "DELETE /compute/v2.1/servers/3a615f10-936f-48d1-aad9-e414dc31d016" status: 204 len: 0 microversion: 2.1 time: 0.348510 Jul 21 20:12:03.115097 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 380/738] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Jul 21 20:12:02 2022] DELETE /compute/v2.1/servers/3a615f10-936f-48d1-aad9-e414dc31d016 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 20:12:03.122931 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-8b1635fa-4beb-4ce7-9369-5f85ec579061 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:12:03.123564 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-8b1635fa-4beb-4ce7-9369-5f85ec579061 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 3a615f10-936f-48d1-aad9-e414dc31d016] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:12:03.129524 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-8b1635fa-4beb-4ce7-9369-5f85ec579061 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:12:03.130485 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-8b1635fa-4beb-4ce7-9369-5f85ec579061 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:12:03.131314 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-8b1635fa-4beb-4ce7-9369-5f85ec579061 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:12:03.131742 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-8b1635fa-4beb-4ce7-9369-5f85ec579061 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:12:03.261948 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-8b1635fa-4beb-4ce7-9369-5f85ec579061 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:12:03.269376 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-8b1635fa-4beb-4ce7-9369-5f85ec579061 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/3a615f10-936f-48d1-aad9-e414dc31d016" status: 200 len: 1521 microversion: 2.1 time: 0.150299 Jul 21 20:12:03.269938 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 359/739] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:12:03 2022] GET /compute/v2.1/servers/3a615f10-936f-48d1-aad9-e414dc31d016 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:12:03.438997 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-b64ebae1-c91b-4717-bfcb-2bf13d002c6c tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:12:03.439643 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-b64ebae1-c91b-4717-bfcb-2bf13d002c6c tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] [instance: 301ed3ad-5cb4-4ebf-ac32-519ab482cdea] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:12:03.446130 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b64ebae1-c91b-4717-bfcb-2bf13d002c6c tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:12:03.446575 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b64ebae1-c91b-4717-bfcb-2bf13d002c6c tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:12:03.447360 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b64ebae1-c91b-4717-bfcb-2bf13d002c6c tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:12:03.447789 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b64ebae1-c91b-4717-bfcb-2bf13d002c6c tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:12:03.576134 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-b64ebae1-c91b-4717-bfcb-2bf13d002c6c tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf78e0fe86d4e078c0527248af45cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4239f4ae39bb49cf8063377a93875456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:12:03.583587 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-b64ebae1-c91b-4717-bfcb-2bf13d002c6c tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] 10.222.0.58 "GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea" status: 200 len: 1575 microversion: 2.1 time: 0.148795 Jul 21 20:12:03.584144 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 381/740] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:12:03 2022] GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea => generated 1575 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:12:04.287464 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-b60498c7-30a1-4208-b6a6-3cf5ccb666cc tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:12:04.288096 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-b60498c7-30a1-4208-b6a6-3cf5ccb666cc tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 3a615f10-936f-48d1-aad9-e414dc31d016] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:12:04.294542 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-b60498c7-30a1-4208-b6a6-3cf5ccb666cc tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:12:04.294983 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-b60498c7-30a1-4208-b6a6-3cf5ccb666cc tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:12:04.295764 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-b60498c7-30a1-4208-b6a6-3cf5ccb666cc tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:12:04.296195 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-b60498c7-30a1-4208-b6a6-3cf5ccb666cc tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:12:04.436175 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-b60498c7-30a1-4208-b6a6-3cf5ccb666cc tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:12:04.444247 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-b60498c7-30a1-4208-b6a6-3cf5ccb666cc tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/3a615f10-936f-48d1-aad9-e414dc31d016" status: 200 len: 1521 microversion: 2.1 time: 0.161225 Jul 21 20:12:04.444809 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 360/741] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:12:04 2022] GET /compute/v2.1/servers/3a615f10-936f-48d1-aad9-e414dc31d016 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:12:04.600655 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-253ee3ba-5165-41b5-90ba-ef5a3249ebe1 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:12:04.601267 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-253ee3ba-5165-41b5-90ba-ef5a3249ebe1 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] [instance: 301ed3ad-5cb4-4ebf-ac32-519ab482cdea] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:12:04.607222 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-253ee3ba-5165-41b5-90ba-ef5a3249ebe1 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:12:04.607665 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-253ee3ba-5165-41b5-90ba-ef5a3249ebe1 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:12:04.608427 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-253ee3ba-5165-41b5-90ba-ef5a3249ebe1 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:12:04.608853 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-253ee3ba-5165-41b5-90ba-ef5a3249ebe1 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:12:04.746780 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-253ee3ba-5165-41b5-90ba-ef5a3249ebe1 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf78e0fe86d4e078c0527248af45cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4239f4ae39bb49cf8063377a93875456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:12:04.755761 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-253ee3ba-5165-41b5-90ba-ef5a3249ebe1 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] 10.222.0.58 "GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea" status: 200 len: 1575 microversion: 2.1 time: 0.159905 Jul 21 20:12:04.756329 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 382/742] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:12:04 2022] GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:12:05.462095 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-cbabee4e-1c71-4171-92dc-609e1c9acf98 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:12:05.462702 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-cbabee4e-1c71-4171-92dc-609e1c9acf98 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 3a615f10-936f-48d1-aad9-e414dc31d016] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:12:05.469436 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-cbabee4e-1c71-4171-92dc-609e1c9acf98 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:12:05.469888 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-cbabee4e-1c71-4171-92dc-609e1c9acf98 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:12:05.470889 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-cbabee4e-1c71-4171-92dc-609e1c9acf98 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:12:05.471357 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-cbabee4e-1c71-4171-92dc-609e1c9acf98 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:12:05.594858 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-cbabee4e-1c71-4171-92dc-609e1c9acf98 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:12:05.602500 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-cbabee4e-1c71-4171-92dc-609e1c9acf98 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/3a615f10-936f-48d1-aad9-e414dc31d016" status: 200 len: 1521 microversion: 2.1 time: 0.144881 Jul 21 20:12:05.603079 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 361/743] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:12:05 2022] GET /compute/v2.1/servers/3a615f10-936f-48d1-aad9-e414dc31d016 => generated 1521 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:12:05.773364 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-92a76c5d-4a86-4d19-8fb7-2732d1b78c23 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:12:05.773884 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-92a76c5d-4a86-4d19-8fb7-2732d1b78c23 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] [instance: 301ed3ad-5cb4-4ebf-ac32-519ab482cdea] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:12:05.780016 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-92a76c5d-4a86-4d19-8fb7-2732d1b78c23 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:12:05.780472 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-92a76c5d-4a86-4d19-8fb7-2732d1b78c23 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:12:05.781241 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-92a76c5d-4a86-4d19-8fb7-2732d1b78c23 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:12:05.781675 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-92a76c5d-4a86-4d19-8fb7-2732d1b78c23 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:12:05.808483 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [req-0f7b1016-2efc-40a9-8753-68a6b627682e req-a17acca2-ecb9-411b-8afd-071a68f496d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "301ed3ad-5cb4-4ebf-ac32-519ab482cdea", "name": "network-vif-plugged", "status": "completed", "tag": "4300c7df-3693-4c3f-ae64-d9d267e9d57d"}]} {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:12:05.816691 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [req-0f7b1016-2efc-40a9-8753-68a6b627682e req-a17acca2-ecb9-411b-8afd-071a68f496d0 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:12:05.817193 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [req-0f7b1016-2efc-40a9-8753-68a6b627682e req-a17acca2-ecb9-411b-8afd-071a68f496d0 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:12:05.828949 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.compute.server_external_events [req-0f7b1016-2efc-40a9-8753-68a6b627682e req-a17acca2-ecb9-411b-8afd-071a68f496d0 service nova] Creating event network-vif-plugged:4300c7df-3693-4c3f-ae64-d9d267e9d57d for instance 301ed3ad-5cb4-4ebf-ac32-519ab482cdea on hv-cinder-85054 Jul 21 20:12:05.834027 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [req-0f7b1016-2efc-40a9-8753-68a6b627682e req-a17acca2-ecb9-411b-8afd-071a68f496d0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029302 Jul 21 20:12:05.834626 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 362/744] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 20:12:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 20:12:05.913914 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-92a76c5d-4a86-4d19-8fb7-2732d1b78c23 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf78e0fe86d4e078c0527248af45cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4239f4ae39bb49cf8063377a93875456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:12:05.921682 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-92a76c5d-4a86-4d19-8fb7-2732d1b78c23 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] 10.222.0.58 "GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea" status: 200 len: 1575 microversion: 2.1 time: 0.152578 Jul 21 20:12:05.922398 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 383/745] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:12:05 2022] GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:12:06.620861 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-15d66228-39b4-488d-ad66-156d273d58af tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:12:06.621564 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-15d66228-39b4-488d-ad66-156d273d58af tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 3a615f10-936f-48d1-aad9-e414dc31d016] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:12:06.628058 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-15d66228-39b4-488d-ad66-156d273d58af tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:12:06.628495 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-15d66228-39b4-488d-ad66-156d273d58af tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:12:06.630939 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-15d66228-39b4-488d-ad66-156d273d58af tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:12:06.630939 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-15d66228-39b4-488d-ad66-156d273d58af tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:12:06.763230 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-15d66228-39b4-488d-ad66-156d273d58af tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:12:06.765516 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG dbcounter [-] [118344] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:12:06.771851 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-15d66228-39b4-488d-ad66-156d273d58af tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/3a615f10-936f-48d1-aad9-e414dc31d016" status: 200 len: 1521 microversion: 2.1 time: 0.156270 Jul 21 20:12:06.773416 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 363/746] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:12:06 2022] GET /compute/v2.1/servers/3a615f10-936f-48d1-aad9-e414dc31d016 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:12:06.939645 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-2b0b98ee-d40c-48f2-a4d7-475264643837 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:12:06.940278 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-2b0b98ee-d40c-48f2-a4d7-475264643837 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] [instance: 301ed3ad-5cb4-4ebf-ac32-519ab482cdea] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:12:06.946669 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2b0b98ee-d40c-48f2-a4d7-475264643837 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:12:06.947144 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2b0b98ee-d40c-48f2-a4d7-475264643837 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:12:06.947892 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2b0b98ee-d40c-48f2-a4d7-475264643837 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:12:06.948338 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2b0b98ee-d40c-48f2-a4d7-475264643837 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:12:07.077373 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-2b0b98ee-d40c-48f2-a4d7-475264643837 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf78e0fe86d4e078c0527248af45cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4239f4ae39bb49cf8063377a93875456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:12:07.085365 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-2b0b98ee-d40c-48f2-a4d7-475264643837 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] 10.222.0.58 "GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea" status: 200 len: 1575 microversion: 2.1 time: 0.149515 Jul 21 20:12:07.085925 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 384/747] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:12:06 2022] GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea => generated 1575 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:12:07.789768 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-467ac20f-da5b-4009-92d5-edab99665788 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:12:07.790367 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-467ac20f-da5b-4009-92d5-edab99665788 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 3a615f10-936f-48d1-aad9-e414dc31d016] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:12:07.797370 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-467ac20f-da5b-4009-92d5-edab99665788 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:12:07.797809 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-467ac20f-da5b-4009-92d5-edab99665788 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:12:07.798567 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-467ac20f-da5b-4009-92d5-edab99665788 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:12:07.799000 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-467ac20f-da5b-4009-92d5-edab99665788 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:12:07.944741 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-467ac20f-da5b-4009-92d5-edab99665788 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:12:07.944741 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-467ac20f-da5b-4009-92d5-edab99665788 tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/3a615f10-936f-48d1-aad9-e414dc31d016" status: 200 len: 1521 microversion: 2.1 time: 0.159769 Jul 21 20:12:07.945605 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 364/748] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:12:07 2022] GET /compute/v2.1/servers/3a615f10-936f-48d1-aad9-e414dc31d016 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:12:08.102543 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-eedd7caf-b4ae-44fc-9b3f-c40e7dec66f1 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:12:08.103217 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-eedd7caf-b4ae-44fc-9b3f-c40e7dec66f1 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] [instance: 301ed3ad-5cb4-4ebf-ac32-519ab482cdea] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:12:08.105250 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:12:08.109975 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-eedd7caf-b4ae-44fc-9b3f-c40e7dec66f1 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:12:08.110421 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-eedd7caf-b4ae-44fc-9b3f-c40e7dec66f1 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:12:08.111225 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-eedd7caf-b4ae-44fc-9b3f-c40e7dec66f1 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:12:08.111660 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-eedd7caf-b4ae-44fc-9b3f-c40e7dec66f1 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:12:08.277939 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-eedd7caf-b4ae-44fc-9b3f-c40e7dec66f1 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf78e0fe86d4e078c0527248af45cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4239f4ae39bb49cf8063377a93875456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:12:08.289112 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-eedd7caf-b4ae-44fc-9b3f-c40e7dec66f1 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] 10.222.0.58 "GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea" status: 200 len: 1575 microversion: 2.1 time: 0.190870 Jul 21 20:12:08.290196 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 385/749] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:12:08 2022] GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea => generated 1575 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:12:08.352526 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [req-917bb7e0-ef92-49be-bb8f-ae35abe087d0 req-2d11f8cb-79c7-4c49-85c2-c2388d36b0cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a615f10-936f-48d1-aad9-e414dc31d016", "name": "network-vif-deleted", "tag": "a1660b17-172b-4784-a846-78546f7da506"}]} {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:12:08.360534 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [req-917bb7e0-ef92-49be-bb8f-ae35abe087d0 req-2d11f8cb-79c7-4c49-85c2-c2388d36b0cd service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:12:08.360978 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [req-917bb7e0-ef92-49be-bb8f-ae35abe087d0 req-2d11f8cb-79c7-4c49-85c2-c2388d36b0cd service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:12:08.371841 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.compute.server_external_events [req-917bb7e0-ef92-49be-bb8f-ae35abe087d0 req-2d11f8cb-79c7-4c49-85c2-c2388d36b0cd service nova] Creating event network-vif-deleted:a1660b17-172b-4784-a846-78546f7da506 for instance 3a615f10-936f-48d1-aad9-e414dc31d016 on hv-cinder-85054 Jul 21 20:12:08.376587 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [req-917bb7e0-ef92-49be-bb8f-ae35abe087d0 req-2d11f8cb-79c7-4c49-85c2-c2388d36b0cd service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028469 Jul 21 20:12:08.377149 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 365/750] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 20:12:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:12:08.961903 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-03cf0588-cd13-4bc2-9755-99518acbff3f tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:12:08.962512 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-03cf0588-cd13-4bc2-9755-99518acbff3f tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 3a615f10-936f-48d1-aad9-e414dc31d016] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:12:08.969041 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-03cf0588-cd13-4bc2-9755-99518acbff3f tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:12:08.969486 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-03cf0588-cd13-4bc2-9755-99518acbff3f tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:12:08.970296 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-03cf0588-cd13-4bc2-9755-99518acbff3f tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:12:08.970999 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-03cf0588-cd13-4bc2-9755-99518acbff3f tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:12:09.032903 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-03cf0588-cd13-4bc2-9755-99518acbff3f tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:12:09.041052 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-03cf0588-cd13-4bc2-9755-99518acbff3f tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/3a615f10-936f-48d1-aad9-e414dc31d016" status: 200 len: 1306 microversion: 2.1 time: 0.083525 Jul 21 20:12:09.041617 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 386/751] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:12:08 2022] GET /compute/v2.1/servers/3a615f10-936f-48d1-aad9-e414dc31d016 => generated 1306 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:12:09.124038 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-b25fe1f9-dc21-4d5d-92c8-933aed0c5ad9 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:12:09.125076 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-b25fe1f9-dc21-4d5d-92c8-933aed0c5ad9 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:12:09.131786 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-b25fe1f9-dc21-4d5d-92c8-933aed0c5ad9 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:12:09.134036 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-b25fe1f9-dc21-4d5d-92c8-933aed0c5ad9 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:12:09.134036 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-b25fe1f9-dc21-4d5d-92c8-933aed0c5ad9 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:12:09.134036 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-b25fe1f9-dc21-4d5d-92c8-933aed0c5ad9 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:12:09.162964 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-b25fe1f9-dc21-4d5d-92c8-933aed0c5ad9 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043612 Jul 21 20:12:09.163534 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 366/752] 10.222.0.58 () {58 vars in 1301 bytes} [Thu Jul 21 20:12:09 2022] GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 21 20:12:09.220064 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-2b55d987-e0f4-42db-93ba-926ff0a3f24c tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:12:09.220582 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-2b55d987-e0f4-42db-93ba-926ff0a3f24c tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:12:09.226846 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2b55d987-e0f4-42db-93ba-926ff0a3f24c tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:12:09.227436 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2b55d987-e0f4-42db-93ba-926ff0a3f24c tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:12:09.228228 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2b55d987-e0f4-42db-93ba-926ff0a3f24c tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:12:09.228662 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2b55d987-e0f4-42db-93ba-926ff0a3f24c tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:12:09.253391 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-2b55d987-e0f4-42db-93ba-926ff0a3f24c tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a] Going to try to terminate instance {{(pid=118345) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 20:12:09.309766 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-1e192d0f-e69e-495b-aed9-cbd053c12bbb tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:12:09.310372 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-1e192d0f-e69e-495b-aed9-cbd053c12bbb tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] [instance: 301ed3ad-5cb4-4ebf-ac32-519ab482cdea] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:12:09.316621 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-1e192d0f-e69e-495b-aed9-cbd053c12bbb tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:12:09.322383 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-1e192d0f-e69e-495b-aed9-cbd053c12bbb tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:12:09.322383 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-1e192d0f-e69e-495b-aed9-cbd053c12bbb tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:12:09.322383 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-1e192d0f-e69e-495b-aed9-cbd053c12bbb tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:12:09.461733 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-1e192d0f-e69e-495b-aed9-cbd053c12bbb tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf78e0fe86d4e078c0527248af45cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4239f4ae39bb49cf8063377a93875456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:12:09.469399 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-1e192d0f-e69e-495b-aed9-cbd053c12bbb tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] 10.222.0.58 "GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea" status: 200 len: 1562 microversion: 2.1 time: 0.164464 Jul 21 20:12:09.469982 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 367/753] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:12:09 2022] GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea => generated 1562 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:12:09.497780 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-2b55d987-e0f4-42db-93ba-926ff0a3f24c tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "DELETE /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a" status: 204 len: 0 microversion: 2.1 time: 0.281328 Jul 21 20:12:09.498356 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 387/754] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Jul 21 20:12:09 2022] DELETE /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 20:12:09.506990 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-e6acfdb8-dac6-472d-92a9-c79709c7d891 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:12:09.511691 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-e6acfdb8-dac6-472d-92a9-c79709c7d891 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:12:09.513587 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-e6acfdb8-dac6-472d-92a9-c79709c7d891 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:12:09.514039 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-e6acfdb8-dac6-472d-92a9-c79709c7d891 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:12:09.514801 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-e6acfdb8-dac6-472d-92a9-c79709c7d891 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:12:09.515264 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-e6acfdb8-dac6-472d-92a9-c79709c7d891 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:12:09.643498 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-e6acfdb8-dac6-472d-92a9-c79709c7d891 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:12:09.650232 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-e6acfdb8-dac6-472d-92a9-c79709c7d891 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a" status: 200 len: 1673 microversion: 2.1 time: 0.147656 Jul 21 20:12:09.650791 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 368/755] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:12:09 2022] GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a => generated 1673 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:12:10.058288 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-5582c35b-0abd-42d7-8bbe-9681c5753bbe tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:12:10.058896 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-5582c35b-0abd-42d7-8bbe-9681c5753bbe tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 3a615f10-936f-48d1-aad9-e414dc31d016] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:12:10.065008 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5582c35b-0abd-42d7-8bbe-9681c5753bbe tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:12:10.065446 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5582c35b-0abd-42d7-8bbe-9681c5753bbe tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:12:10.066199 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5582c35b-0abd-42d7-8bbe-9681c5753bbe tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:12:10.066623 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5582c35b-0abd-42d7-8bbe-9681c5753bbe tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:12:10.097245 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5582c35b-0abd-42d7-8bbe-9681c5753bbe tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:12:10.097679 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5582c35b-0abd-42d7-8bbe-9681c5753bbe tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:12:10.098114 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.objects.instance [None req-5582c35b-0abd-42d7-8bbe-9681c5753bbe tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lazy-loading 'fault' on Instance uuid 3a615f10-936f-48d1-aad9-e414dc31d016 {{(pid=118345) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 20:12:10.141398 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-5582c35b-0abd-42d7-8bbe-9681c5753bbe tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9139f72d004b2fac1cba17647c129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4acf1287ad4dac9bbf6dc27f427a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:12:10.149299 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-5582c35b-0abd-42d7-8bbe-9681c5753bbe tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/3a615f10-936f-48d1-aad9-e414dc31d016" status: 200 len: 1311 microversion: 2.1 time: 0.095373 Jul 21 20:12:10.149855 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 388/756] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:12:10 2022] GET /compute/v2.1/servers/3a615f10-936f-48d1-aad9-e414dc31d016 => generated 1311 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:12:10.667205 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-b675c7b9-9d47-453c-ab52-3c2fd0e32ac2 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:12:10.667889 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-b675c7b9-9d47-453c-ab52-3c2fd0e32ac2 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:12:10.674393 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-b675c7b9-9d47-453c-ab52-3c2fd0e32ac2 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:12:10.674834 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-b675c7b9-9d47-453c-ab52-3c2fd0e32ac2 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:12:10.675632 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-b675c7b9-9d47-453c-ab52-3c2fd0e32ac2 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:12:10.676063 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-b675c7b9-9d47-453c-ab52-3c2fd0e32ac2 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:12:10.804817 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-b675c7b9-9d47-453c-ab52-3c2fd0e32ac2 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:12:10.813173 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-b675c7b9-9d47-453c-ab52-3c2fd0e32ac2 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a" status: 200 len: 1673 microversion: 2.1 time: 0.149972 Jul 21 20:12:10.813748 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 369/757] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:12:10 2022] GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a => generated 1673 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:12:11.166957 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-21f3d005-698f-463e-add3-73d005aba20f tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:12:11.168172 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-21f3d005-698f-463e-add3-73d005aba20f tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] [instance: 3a615f10-936f-48d1-aad9-e414dc31d016] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:12:11.174132 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-21f3d005-698f-463e-add3-73d005aba20f tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:12:11.174577 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-21f3d005-698f-463e-add3-73d005aba20f tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:12:11.175393 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-21f3d005-698f-463e-add3-73d005aba20f tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:12:11.175823 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-21f3d005-698f-463e-add3-73d005aba20f tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:12:11.188727 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.wsgi [None req-21f3d005-698f-463e-add3-73d005aba20f tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] HTTP exception thrown: Instance 3a615f10-936f-48d1-aad9-e414dc31d016 could not be found. Jul 21 20:12:11.190346 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-21f3d005-698f-463e-add3-73d005aba20f tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Request method failure captured: Jul 21 20:12:11.190346 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: request: GET /compute/v2.1/servers/3a615f10-936f-48d1-aad9-e414dc31d016 HTTP/1.1 Jul 21 20:12:11.190346 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Accept: application/json Jul 21 20:12:11.190346 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Accept-Encoding: identity Jul 21 20:12:11.190346 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Connection: close Jul 21 20:12:11.190346 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Content-Length: 0 Jul 21 20:12:11.190346 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Content-Type: application/json Jul 21 20:12:11.190346 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Host: 10.222.0.58 Jul 21 20:12:11.190346 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Openstack-System-Scope: None Jul 21 20:12:11.190346 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: User-Agent: python-urllib3/1.26.9 Jul 21 20:12:11.190346 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Auth-Token: gAAAAABi2bFozFOmeFjCWltvy8VhOWCofqDkL3eFiDeXHKMTK5OfgvASsxAtL3iRYEdZZ7pOuKVQA34GMN_bqQ_UDkdmJ9edR5NJ1MVnnwiRBdlInNadgfKnNIDs7Z86jLqiTMWRcpjxhBqQIcTH49W1JEnUteXxWbRKxG7NWslugE8wtbbj48I Jul 21 20:12:11.190346 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Domain-Id: None Jul 21 20:12:11.190346 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Domain-Name: None Jul 21 20:12:11.190346 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Identity-Status: Confirmed Jul 21 20:12:11.190346 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Is-Admin-Project: True Jul 21 20:12:11.190346 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Id: default Jul 21 20:12:11.190346 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Name: Default Jul 21 20:12:11.190346 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Id: 6d4acf1287ad4dac9bbf6dc27f427a7c Jul 21 20:12:11.190346 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1971750390 Jul 21 20:12:11.190346 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Role: reader,member Jul 21 20:12:11.190346 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Roles: reader,member Jul 21 20:12:11.191891 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/6d4acf1287ad4dac9bbf6dc27f427a7c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6d4acf1287ad4dac9bbf6dc27f427a7c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_6d4acf1287ad4dac9bbf6dc27f427a7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6d4acf1287ad4dac9bbf6dc27f427a7c"}]}] Jul 21 20:12:11.191891 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1971750390 Jul 21 20:12:11.191891 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Tenant-Id: 6d4acf1287ad4dac9bbf6dc27f427a7c Jul 21 20:12:11.191891 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1971750390 Jul 21 20:12:11.191891 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User: tempest-ServerRescueNegativeTestJSON-1971750390-project Jul 21 20:12:11.191891 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Id: default Jul 21 20:12:11.191891 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Name: Default Jul 21 20:12:11.191891 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Id: df9139f72d004b2fac1cba17647c129d Jul 21 20:12:11.191891 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1971750390-project Jul 21 20:12:11.191891 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: method: > Jul 21 20:12:11.191891 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: exception: Instance 3a615f10-936f-48d1-aad9-e414dc31d016 could not be found. Jul 21 20:12:11.191891 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: action_args: {'id': '3a615f10-936f-48d1-aad9-e414dc31d016'} Jul 21 20:12:11.192650 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 20:12:11.192650 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:12:11.192650 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 20:12:11.192650 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 20:12:11.192650 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 20:12:11.192650 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 20:12:11.192650 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 20:12:11.192650 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 20:12:11.192650 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 20:12:11.192650 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 20:12:11.192650 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a615f10-936f-48d1-aad9-e414dc31d016 could not be found. Jul 21 20:12:11.192650 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:12:11.192650 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:12:11.192650 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:12:11.192650 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:12:11.192650 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:12:11.192650 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:12:11.192650 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 20:12:11.192650 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 20:12:11.192650 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 20:12:11.194031 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 20:12:11.194031 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 20:12:11.194031 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 20:12:11.194031 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 20:12:11.194031 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 20:12:11.194031 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 20:12:11.194031 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 20:12:11.194031 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a615f10-936f-48d1-aad9-e414dc31d016 could not be found. Jul 21 20:12:11.194031 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:12:11.194031 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:12:11.194031 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:12:11.194031 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:12:11.194031 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:12:11.194031 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:12:11.194031 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 20:12:11.194031 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 20:12:11.194031 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a615f10-936f-48d1-aad9-e414dc31d016 could not be found. Jul 21 20:12:11.194031 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:12:11.195327 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-21f3d005-698f-463e-add3-73d005aba20f tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] Returning 404 to user: Instance 3a615f10-936f-48d1-aad9-e414dc31d016 could not be found. {{(pid=118345) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 20:12:11.195327 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-21f3d005-698f-463e-add3-73d005aba20f tempest-ServerRescueNegativeTestJSON-1971750390 tempest-ServerRescueNegativeTestJSON-1971750390-project] 10.222.0.58 "GET /compute/v2.1/servers/3a615f10-936f-48d1-aad9-e414dc31d016" status: 404 len: 111 microversion: 2.1 time: 0.028757 Jul 21 20:12:11.195327 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 389/758] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:12:11 2022] GET /compute/v2.1/servers/3a615f10-936f-48d1-aad9-e414dc31d016 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 20:12:11.830218 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-47b0294e-d945-4807-a485-c61708309ced tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:12:11.831450 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-47b0294e-d945-4807-a485-c61708309ced tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:12:11.841211 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-47b0294e-d945-4807-a485-c61708309ced tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:12:11.842071 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-47b0294e-d945-4807-a485-c61708309ced tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:12:11.843090 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-47b0294e-d945-4807-a485-c61708309ced tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:12:11.843735 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-47b0294e-d945-4807-a485-c61708309ced tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:12:11.896558 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [req-31090792-6c46-40c0-b7b8-50d8044386fc req-5af2f843-3fee-4c20-a916-6fc0288b64e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a", "name": "network-vif-deleted", "tag": "4ee28e4e-c490-4447-b3bb-8dbba6042538"}]} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:12:11.905777 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-31090792-6c46-40c0-b7b8-50d8044386fc req-5af2f843-3fee-4c20-a916-6fc0288b64e2 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:12:11.905777 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-31090792-6c46-40c0-b7b8-50d8044386fc req-5af2f843-3fee-4c20-a916-6fc0288b64e2 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:12:11.917276 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.compute.server_external_events [req-31090792-6c46-40c0-b7b8-50d8044386fc req-5af2f843-3fee-4c20-a916-6fc0288b64e2 service nova] Creating event network-vif-deleted:4ee28e4e-c490-4447-b3bb-8dbba6042538 for instance 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a on hv-cinder-85054 Jul 21 20:12:11.922249 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [req-31090792-6c46-40c0-b7b8-50d8044386fc req-5af2f843-3fee-4c20-a916-6fc0288b64e2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029960 Jul 21 20:12:11.923050 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 390/759] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 20:12:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 20:12:11.932809 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-47b0294e-d945-4807-a485-c61708309ced tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:12:11.940368 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-47b0294e-d945-4807-a485-c61708309ced tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a" status: 200 len: 1606 microversion: 2.1 time: 0.114431 Jul 21 20:12:11.941727 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 370/760] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:12:11 2022] GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a => generated 1606 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:12:12.959890 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-28d3b2a3-a07e-4a7a-b9a2-2104dfd16601 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:12:12.960502 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-28d3b2a3-a07e-4a7a-b9a2-2104dfd16601 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:12:12.966921 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-28d3b2a3-a07e-4a7a-b9a2-2104dfd16601 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:12:12.967405 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-28d3b2a3-a07e-4a7a-b9a2-2104dfd16601 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:12:12.968176 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-28d3b2a3-a07e-4a7a-b9a2-2104dfd16601 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:12:12.968609 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-28d3b2a3-a07e-4a7a-b9a2-2104dfd16601 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:12:13.003553 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-28d3b2a3-a07e-4a7a-b9a2-2104dfd16601 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:12:13.004015 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-28d3b2a3-a07e-4a7a-b9a2-2104dfd16601 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:12:13.004747 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.objects.instance [None req-28d3b2a3-a07e-4a7a-b9a2-2104dfd16601 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lazy-loading 'fault' on Instance uuid 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a {{(pid=118345) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 20:12:13.049570 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-28d3b2a3-a07e-4a7a-b9a2-2104dfd16601 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:12:13.057099 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-28d3b2a3-a07e-4a7a-b9a2-2104dfd16601 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a" status: 200 len: 1327 microversion: 2.1 time: 0.101704 Jul 21 20:12:13.057660 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 391/761] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:12:12 2022] GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a => generated 1327 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:12:14.074028 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-a6b09de6-2732-4fb9-b215-4b38caef9748 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:12:14.075452 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-a6b09de6-2732-4fb9-b215-4b38caef9748 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:12:14.082419 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-a6b09de6-2732-4fb9-b215-4b38caef9748 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:12:14.082874 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-a6b09de6-2732-4fb9-b215-4b38caef9748 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:12:14.083773 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-a6b09de6-2732-4fb9-b215-4b38caef9748 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:12:14.084208 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-a6b09de6-2732-4fb9-b215-4b38caef9748 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:12:14.098440 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.wsgi [None req-a6b09de6-2732-4fb9-b215-4b38caef9748 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] HTTP exception thrown: Instance 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a could not be found. Jul 21 20:12:14.101466 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-a6b09de6-2732-4fb9-b215-4b38caef9748 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Request method failure captured: Jul 21 20:12:14.101466 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: request: GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a HTTP/1.1 Jul 21 20:12:14.101466 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Accept: application/json Jul 21 20:12:14.101466 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Accept-Encoding: identity Jul 21 20:12:14.101466 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Connection: close Jul 21 20:12:14.101466 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Content-Length: 0 Jul 21 20:12:14.101466 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Content-Type: application/json Jul 21 20:12:14.101466 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Host: 10.222.0.58 Jul 21 20:12:14.101466 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Openstack-System-Scope: None Jul 21 20:12:14.101466 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: User-Agent: python-urllib3/1.26.9 Jul 21 20:12:14.101466 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Auth-Token: gAAAAABi2bFqawBPFOQp1wWmwqJOOXeis8PNAU6t8AByTK4V8YRXmgW1TS61qGCWegZqRl0cYUnZg1X1Pj-fJHVOTSfoJUElaXEpJN_utV820G7q93tULhE4p8bZ2t6owNOiWk_ziZzytmo_LcxBwsurYvzIMPkunF875WGX-vUiLw6yUYkuMzU Jul 21 20:12:14.101466 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Domain-Id: None Jul 21 20:12:14.101466 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Domain-Name: None Jul 21 20:12:14.101466 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Identity-Status: Confirmed Jul 21 20:12:14.101466 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Is-Admin-Project: True Jul 21 20:12:14.101466 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Domain-Id: default Jul 21 20:12:14.101466 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Domain-Name: Default Jul 21 20:12:14.101466 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Id: f5e462e9247c4feab7e498186a547728 Jul 21 20:12:14.101466 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Name: tempest-AttachVolumeTestJSON-1902670070 Jul 21 20:12:14.101466 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Role: reader,member Jul 21 20:12:14.101466 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Roles: reader,member Jul 21 20:12:14.102685 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f5e462e9247c4feab7e498186a547728"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f5e462e9247c4feab7e498186a547728"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f5e462e9247c4feab7e498186a547728"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f5e462e9247c4feab7e498186a547728"}]}] Jul 21 20:12:14.102685 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Tenant: tempest-AttachVolumeTestJSON-1902670070 Jul 21 20:12:14.102685 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Tenant-Id: f5e462e9247c4feab7e498186a547728 Jul 21 20:12:14.102685 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1902670070 Jul 21 20:12:14.102685 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User: tempest-AttachVolumeTestJSON-1902670070-project Jul 21 20:12:14.102685 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Domain-Id: default Jul 21 20:12:14.102685 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Domain-Name: Default Jul 21 20:12:14.102685 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Id: 44f668466fa542039e88b4fc7714de81 Jul 21 20:12:14.102685 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Name: tempest-AttachVolumeTestJSON-1902670070-project Jul 21 20:12:14.102685 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: method: > Jul 21 20:12:14.102685 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: exception: Instance 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a could not be found. Jul 21 20:12:14.102685 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: action_args: {'id': '4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a'} Jul 21 20:12:14.103434 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 20:12:14.103434 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:12:14.103434 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 20:12:14.103434 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 20:12:14.103434 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 20:12:14.103434 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 20:12:14.103434 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 20:12:14.103434 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 20:12:14.103434 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 20:12:14.103434 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 20:12:14.103434 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a could not be found. Jul 21 20:12:14.103434 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:12:14.103434 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:12:14.103434 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:12:14.103434 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:12:14.103434 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:12:14.103434 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:12:14.103434 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 20:12:14.103434 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 20:12:14.103434 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 20:12:14.104698 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 20:12:14.104698 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 20:12:14.104698 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 20:12:14.104698 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 20:12:14.104698 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 20:12:14.104698 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 20:12:14.104698 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 20:12:14.104698 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a could not be found. Jul 21 20:12:14.104698 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:12:14.104698 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:12:14.104698 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:12:14.104698 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:12:14.104698 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:12:14.104698 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:12:14.104698 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 20:12:14.104698 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 20:12:14.104698 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a could not be found. Jul 21 20:12:14.104698 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:12:14.106644 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-a6b09de6-2732-4fb9-b215-4b38caef9748 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Returning 404 to user: Instance 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a could not be found. {{(pid=118344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 20:12:14.107536 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-a6b09de6-2732-4fb9-b215-4b38caef9748 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a" status: 404 len: 111 microversion: 2.1 time: 0.037746 Jul 21 20:12:14.108091 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 371/762] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:12:14 2022] GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 20:12:14.116941 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-65bf4022-771f-4454-8a35-2e273124a232 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '.version_select at 0x7f351ccac1f0>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:12:14.230758 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-65bf4022-771f-4454-8a35-2e273124a232 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-653216594" status: 202 len: 0 microversion: 2.1 time: 0.118071 Jul 21 20:12:14.231438 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 392/763] 10.222.0.58 () {58 vars in 1217 bytes} [Thu Jul 21 20:12:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-653216594 => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 20:12:15.396485 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-3af5b01f-b36c-4352-a990-d0ed33e35b8a tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Action: 'create', calling method: .version_select at 0x7f351cd411f0>, body: {"keypair": {"name": "tempest-keypair-1717438764", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNmT5A3v4mPFNSuo5vxkIQlPEybOC32PpdpO6SoBDVNUUL9oq//fE9/H9OGLVp3oJyHE+mjzn+cobwT3EKZbywUNGuN4xuWyHxnbb7l+HtMIEwRI8DmJ4Olt9Hl42Cb/hg=="}} {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:12:15.410937 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.quota [None req-3af5b01f-b36c-4352-a990-d0ed33e35b8a tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Getting quotas for project f5e462e9247c4feab7e498186a547728. Resources: {'key_pairs'} {{(pid=118344) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 20:12:15.414837 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.quota [None req-3af5b01f-b36c-4352-a990-d0ed33e35b8a tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Getting quotas for user 44f668466fa542039e88b4fc7714de81 and project f5e462e9247c4feab7e498186a547728. Resources: {'key_pairs'} {{(pid=118344) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 20:12:15.520376 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-3af5b01f-b36c-4352-a990-d0ed33e35b8a tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.127821 Jul 21 20:12:15.521168 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 372/764] 10.222.0.58 () {60 vars in 1158 bytes} [Thu Jul 21 20:12:15 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:12:18.057206 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-3ea91fb4-3804-4ff5-8cf0-d998c52d0b1c tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1167762018", "imageRef": "357a1479-6cbd-4882-8d3f-d945fa40e6df", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cd4c759b-bfd8-477c-ab70-2c24a78186e7"}], "security_groups": [{"name": "tempest-securitygroup--1168213598"}], "key_name": "tempest-keypair-1717438764", "user_data": "}} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:12:18.163511 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.network.neutron [None req-3ea91fb4-3804-4ff5-8cf0-d998c52d0b1c tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] validate_networks() for [('cd4c759b-bfd8-477c-ab70-2c24a78186e7', None, None, None, None, None)] {{(pid=118345) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 20:12:18.883268 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-3ea91fb4-3804-4ff5-8cf0-d998c52d0b1c tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Flavor limits 0:0:0 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 20:12:18.883786 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-3ea91fb4-3804-4ff5-8cf0-d998c52d0b1c tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Image limits 0:0:0 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 20:12:18.884333 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-3ea91fb4-3804-4ff5-8cf0-d998c52d0b1c tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Flavor pref 0:0:0 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 20:12:18.884814 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-3ea91fb4-3804-4ff5-8cf0-d998c52d0b1c tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Image pref 0:0:0 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 20:12:18.885291 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-3ea91fb4-3804-4ff5-8cf0-d998c52d0b1c tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 20:12:18.894091 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3ea91fb4-3804-4ff5-8cf0-d998c52d0b1c tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:12:18.894530 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3ea91fb4-3804-4ff5-8cf0-d998c52d0b1c tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:12:18.895364 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3ea91fb4-3804-4ff5-8cf0-d998c52d0b1c tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:12:18.895798 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3ea91fb4-3804-4ff5-8cf0-d998c52d0b1c tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:12:18.913066 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.quota [None req-3ea91fb4-3804-4ff5-8cf0-d998c52d0b1c tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Getting quotas for project f5e462e9247c4feab7e498186a547728. Resources: {'instances', 'cores', 'ram'} {{(pid=118345) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 20:12:18.916935 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.quota [None req-3ea91fb4-3804-4ff5-8cf0-d998c52d0b1c tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Getting quotas for user 44f668466fa542039e88b4fc7714de81 and project f5e462e9247c4feab7e498186a547728. Resources: {'instances', 'cores', 'ram'} {{(pid=118345) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 20:12:18.927740 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-3ea91fb4-3804-4ff5-8cf0-d998c52d0b1c tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Going to run 1 instances... {{(pid=118345) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 20:12:18.929963 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-3ea91fb4-3804-4ff5-8cf0-d998c52d0b1c tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: dff45473-c8cb-40c9-8cbb-bc98056c340a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='357a1479-6cbd-4882-8d3f-d945fa40e6df',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118345) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 20:12:19.054214 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-3ea91fb4-3804-4ff5-8cf0-d998c52d0b1c tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.002006 Jul 21 20:12:19.054994 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 393/765] 10.222.0.58 () {60 vars in 1146 bytes} [Thu Jul 21 20:12:18 2022] POST /compute/v2.1/servers => generated 402 bytes in 1003 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 20:12:19.065451 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-ffb09905-1ac8-472d-b8a4-a60247c7f5d4 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:12:19.066055 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-ffb09905-1ac8-472d-b8a4-a60247c7f5d4 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: dff45473-c8cb-40c9-8cbb-bc98056c340a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:12:19.121926 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-ffb09905-1ac8-472d-b8a4-a60247c7f5d4 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:12:19.129311 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-ffb09905-1ac8-472d-b8a4-a60247c7f5d4 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/dff45473-c8cb-40c9-8cbb-bc98056c340a" status: 200 len: 1238 microversion: 2.1 time: 0.068073 Jul 21 20:12:19.130036 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 373/766] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:12:19 2022] GET /compute/v2.1/servers/dff45473-c8cb-40c9-8cbb-bc98056c340a => generated 1238 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:12:20.147933 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-1297c324-1c94-467e-ace3-f03b1e0ae768 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:12:20.150612 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-1297c324-1c94-467e-ace3-f03b1e0ae768 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: dff45473-c8cb-40c9-8cbb-bc98056c340a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:12:20.154953 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1297c324-1c94-467e-ace3-f03b1e0ae768 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:12:20.155449 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1297c324-1c94-467e-ace3-f03b1e0ae768 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:12:20.156205 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1297c324-1c94-467e-ace3-f03b1e0ae768 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:12:20.156630 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1297c324-1c94-467e-ace3-f03b1e0ae768 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:12:20.217077 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-1297c324-1c94-467e-ace3-f03b1e0ae768 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:12:20.225242 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-1297c324-1c94-467e-ace3-f03b1e0ae768 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/dff45473-c8cb-40c9-8cbb-bc98056c340a" status: 200 len: 1242 microversion: 2.1 time: 0.081720 Jul 21 20:12:20.229133 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 394/767] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:12:20 2022] GET /compute/v2.1/servers/dff45473-c8cb-40c9-8cbb-bc98056c340a => generated 1242 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:12:21.242220 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-b1048ef7-63e6-4605-8c48-d9b8cc558c3b tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:12:21.242828 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-b1048ef7-63e6-4605-8c48-d9b8cc558c3b tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: dff45473-c8cb-40c9-8cbb-bc98056c340a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:12:21.249474 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-b1048ef7-63e6-4605-8c48-d9b8cc558c3b tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:12:21.250051 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-b1048ef7-63e6-4605-8c48-d9b8cc558c3b tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:12:21.250818 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-b1048ef7-63e6-4605-8c48-d9b8cc558c3b tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:12:21.251276 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-b1048ef7-63e6-4605-8c48-d9b8cc558c3b tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:12:21.316409 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-b1048ef7-63e6-4605-8c48-d9b8cc558c3b tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:12:21.324683 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-b1048ef7-63e6-4605-8c48-d9b8cc558c3b tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/dff45473-c8cb-40c9-8cbb-bc98056c340a" status: 200 len: 1290 microversion: 2.1 time: 0.086882 Jul 21 20:12:21.325299 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 374/768] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:12:21 2022] GET /compute/v2.1/servers/dff45473-c8cb-40c9-8cbb-bc98056c340a => generated 1290 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:12:22.342886 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-3d1160b6-94b9-42ab-a0e0-41f4b5eeaa6f tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:12:22.343613 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-3d1160b6-94b9-42ab-a0e0-41f4b5eeaa6f tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: dff45473-c8cb-40c9-8cbb-bc98056c340a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:12:22.350229 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3d1160b6-94b9-42ab-a0e0-41f4b5eeaa6f tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:12:22.350683 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3d1160b6-94b9-42ab-a0e0-41f4b5eeaa6f tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:12:22.351496 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3d1160b6-94b9-42ab-a0e0-41f4b5eeaa6f tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:12:22.351928 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3d1160b6-94b9-42ab-a0e0-41f4b5eeaa6f tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:12:22.497278 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-3d1160b6-94b9-42ab-a0e0-41f4b5eeaa6f tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:12:22.505381 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-3d1160b6-94b9-42ab-a0e0-41f4b5eeaa6f tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/dff45473-c8cb-40c9-8cbb-bc98056c340a" status: 200 len: 1364 microversion: 2.1 time: 0.166310 Jul 21 20:12:22.506519 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 395/769] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:12:22 2022] GET /compute/v2.1/servers/dff45473-c8cb-40c9-8cbb-bc98056c340a => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:12:23.509740 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [req-4ced83ab-debe-4e3f-a288-15d94988a4c8 req-15e0fc92-28c4-4808-b599-536e6b469f11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dff45473-c8cb-40c9-8cbb-bc98056c340a", "tag": "90b14516-2737-470e-87c1-cc22ffa351fc"}]} {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:12:23.525514 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-a0d427ee-14f6-4ea0-9b4d-490aed3891d3 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:12:23.526297 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-a0d427ee-14f6-4ea0-9b4d-490aed3891d3 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: dff45473-c8cb-40c9-8cbb-bc98056c340a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:12:23.536075 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a0d427ee-14f6-4ea0-9b4d-490aed3891d3 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:12:23.536517 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a0d427ee-14f6-4ea0-9b4d-490aed3891d3 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:12:23.537288 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a0d427ee-14f6-4ea0-9b4d-490aed3891d3 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:12:23.538451 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a0d427ee-14f6-4ea0-9b4d-490aed3891d3 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:12:23.545508 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [req-4ced83ab-debe-4e3f-a288-15d94988a4c8 req-15e0fc92-28c4-4808-b599-536e6b469f11 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:12:23.546155 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [req-4ced83ab-debe-4e3f-a288-15d94988a4c8 req-15e0fc92-28c4-4808-b599-536e6b469f11 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:12:23.558369 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.compute.server_external_events [req-4ced83ab-debe-4e3f-a288-15d94988a4c8 req-15e0fc92-28c4-4808-b599-536e6b469f11 service nova] Creating event network-changed:90b14516-2737-470e-87c1-cc22ffa351fc for instance dff45473-c8cb-40c9-8cbb-bc98056c340a on hv-cinder-85054 Jul 21 20:12:23.561440 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:12:23.564321 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [req-4ced83ab-debe-4e3f-a288-15d94988a4c8 req-15e0fc92-28c4-4808-b599-536e6b469f11 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068058 Jul 21 20:12:23.565475 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 375/770] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 20:12:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:12:23.752965 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-a0d427ee-14f6-4ea0-9b4d-490aed3891d3 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:12:23.760810 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-a0d427ee-14f6-4ea0-9b4d-490aed3891d3 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/dff45473-c8cb-40c9-8cbb-bc98056c340a" status: 200 len: 1364 microversion: 2.1 time: 0.241688 Jul 21 20:12:23.761372 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 396/771] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:12:23 2022] GET /compute/v2.1/servers/dff45473-c8cb-40c9-8cbb-bc98056c340a => generated 1364 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:12:24.778100 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-445998b7-549c-45b7-9ec5-a830cd7a9ed6 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:12:24.779827 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-445998b7-549c-45b7-9ec5-a830cd7a9ed6 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: dff45473-c8cb-40c9-8cbb-bc98056c340a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:12:24.785588 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-445998b7-549c-45b7-9ec5-a830cd7a9ed6 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:12:24.786034 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-445998b7-549c-45b7-9ec5-a830cd7a9ed6 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:12:24.786795 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-445998b7-549c-45b7-9ec5-a830cd7a9ed6 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:12:24.787261 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-445998b7-549c-45b7-9ec5-a830cd7a9ed6 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:12:24.916670 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-445998b7-549c-45b7-9ec5-a830cd7a9ed6 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:12:24.924045 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-445998b7-549c-45b7-9ec5-a830cd7a9ed6 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/dff45473-c8cb-40c9-8cbb-bc98056c340a" status: 200 len: 1364 microversion: 2.1 time: 0.150171 Jul 21 20:12:24.924613 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 376/772] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:12:24 2022] GET /compute/v2.1/servers/dff45473-c8cb-40c9-8cbb-bc98056c340a => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:12:25.940430 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-297038ed-1b04-4eba-9dbe-193972c77971 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:12:25.940956 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-297038ed-1b04-4eba-9dbe-193972c77971 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: dff45473-c8cb-40c9-8cbb-bc98056c340a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:12:25.947683 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-297038ed-1b04-4eba-9dbe-193972c77971 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:12:25.948147 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-297038ed-1b04-4eba-9dbe-193972c77971 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:12:25.948889 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-297038ed-1b04-4eba-9dbe-193972c77971 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:12:25.949312 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-297038ed-1b04-4eba-9dbe-193972c77971 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:12:26.085019 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-297038ed-1b04-4eba-9dbe-193972c77971 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:12:26.092808 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-297038ed-1b04-4eba-9dbe-193972c77971 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/dff45473-c8cb-40c9-8cbb-bc98056c340a" status: 200 len: 1364 microversion: 2.1 time: 0.156749 Jul 21 20:12:26.093361 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 397/773] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:12:25 2022] GET /compute/v2.1/servers/dff45473-c8cb-40c9-8cbb-bc98056c340a => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:12:27.109386 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-997aeeba-204e-472d-94e8-75a2186a3b2a tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:12:27.110006 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-997aeeba-204e-472d-94e8-75a2186a3b2a tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: dff45473-c8cb-40c9-8cbb-bc98056c340a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:12:27.116487 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-997aeeba-204e-472d-94e8-75a2186a3b2a tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:12:27.116934 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-997aeeba-204e-472d-94e8-75a2186a3b2a tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:12:27.117705 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-997aeeba-204e-472d-94e8-75a2186a3b2a tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:12:27.118144 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-997aeeba-204e-472d-94e8-75a2186a3b2a tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:12:27.249277 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-997aeeba-204e-472d-94e8-75a2186a3b2a tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:12:27.256738 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-997aeeba-204e-472d-94e8-75a2186a3b2a tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/dff45473-c8cb-40c9-8cbb-bc98056c340a" status: 200 len: 1364 microversion: 2.1 time: 0.151214 Jul 21 20:12:27.259895 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 377/774] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:12:27 2022] GET /compute/v2.1/servers/dff45473-c8cb-40c9-8cbb-bc98056c340a => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:12:28.273764 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-ff08002f-db88-40d3-b376-302983106ba2 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:12:28.274374 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-ff08002f-db88-40d3-b376-302983106ba2 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: dff45473-c8cb-40c9-8cbb-bc98056c340a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:12:28.280396 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ff08002f-db88-40d3-b376-302983106ba2 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:12:28.280839 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ff08002f-db88-40d3-b376-302983106ba2 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:12:28.281600 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ff08002f-db88-40d3-b376-302983106ba2 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:12:28.282030 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ff08002f-db88-40d3-b376-302983106ba2 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:12:28.408415 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-ff08002f-db88-40d3-b376-302983106ba2 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:12:28.416191 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-ff08002f-db88-40d3-b376-302983106ba2 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/dff45473-c8cb-40c9-8cbb-bc98056c340a" status: 200 len: 1364 microversion: 2.1 time: 0.146381 Jul 21 20:12:28.416770 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 398/775] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:12:28 2022] GET /compute/v2.1/servers/dff45473-c8cb-40c9-8cbb-bc98056c340a => generated 1364 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:12:29.432019 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-c84120b3-2b47-4247-b4c2-4d8725205f06 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:12:29.432628 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-c84120b3-2b47-4247-b4c2-4d8725205f06 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: dff45473-c8cb-40c9-8cbb-bc98056c340a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:12:29.434999 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG dbcounter [-] [118344] Writing DB stats nova_cell0:SELECT=6 {{(pid=118344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:12:29.435681 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG dbcounter [-] [118344] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=1 {{(pid=118344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:12:29.440358 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-c84120b3-2b47-4247-b4c2-4d8725205f06 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:12:29.440803 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-c84120b3-2b47-4247-b4c2-4d8725205f06 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:12:29.441560 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-c84120b3-2b47-4247-b4c2-4d8725205f06 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:12:29.441990 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-c84120b3-2b47-4247-b4c2-4d8725205f06 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:12:29.569873 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-c84120b3-2b47-4247-b4c2-4d8725205f06 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:12:29.577779 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-c84120b3-2b47-4247-b4c2-4d8725205f06 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/dff45473-c8cb-40c9-8cbb-bc98056c340a" status: 200 len: 1364 microversion: 2.1 time: 0.149720 Jul 21 20:12:29.578341 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 378/776] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:12:29 2022] GET /compute/v2.1/servers/dff45473-c8cb-40c9-8cbb-bc98056c340a => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:12:30.594604 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-6cb6609d-1084-4635-9c95-98d968c70cf9 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:12:30.596697 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-6cb6609d-1084-4635-9c95-98d968c70cf9 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: dff45473-c8cb-40c9-8cbb-bc98056c340a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:12:30.597386 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell0:SELECT=2 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:12:30.598065 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell0:SELECT=6 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:12:30.602855 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6cb6609d-1084-4635-9c95-98d968c70cf9 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:12:30.604310 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6cb6609d-1084-4635-9c95-98d968c70cf9 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:12:30.605801 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6cb6609d-1084-4635-9c95-98d968c70cf9 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:12:30.605801 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6cb6609d-1084-4635-9c95-98d968c70cf9 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:12:30.734217 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-6cb6609d-1084-4635-9c95-98d968c70cf9 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:12:30.741570 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-6cb6609d-1084-4635-9c95-98d968c70cf9 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/dff45473-c8cb-40c9-8cbb-bc98056c340a" status: 200 len: 1364 microversion: 2.1 time: 0.150937 Jul 21 20:12:30.742136 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 399/777] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:12:30 2022] GET /compute/v2.1/servers/dff45473-c8cb-40c9-8cbb-bc98056c340a => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:12:31.758359 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-09f180c1-9bde-4580-80a9-3f6cdbefc215 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:12:31.758887 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-09f180c1-9bde-4580-80a9-3f6cdbefc215 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: dff45473-c8cb-40c9-8cbb-bc98056c340a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:12:31.766291 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-09f180c1-9bde-4580-80a9-3f6cdbefc215 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:12:31.776974 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-09f180c1-9bde-4580-80a9-3f6cdbefc215 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:12:31.776974 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-09f180c1-9bde-4580-80a9-3f6cdbefc215 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:12:31.776974 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-09f180c1-9bde-4580-80a9-3f6cdbefc215 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:12:31.895815 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-09f180c1-9bde-4580-80a9-3f6cdbefc215 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:12:31.903726 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-09f180c1-9bde-4580-80a9-3f6cdbefc215 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/dff45473-c8cb-40c9-8cbb-bc98056c340a" status: 200 len: 1364 microversion: 2.1 time: 0.149377 Jul 21 20:12:31.908782 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 379/778] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:12:31 2022] GET /compute/v2.1/servers/dff45473-c8cb-40c9-8cbb-bc98056c340a => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:12:32.921745 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-6229eb9b-1c01-4e24-8d11-3847df26e4ee tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:12:32.922354 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-6229eb9b-1c01-4e24-8d11-3847df26e4ee tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: dff45473-c8cb-40c9-8cbb-bc98056c340a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:12:32.928782 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6229eb9b-1c01-4e24-8d11-3847df26e4ee tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:12:32.929232 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6229eb9b-1c01-4e24-8d11-3847df26e4ee tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:12:32.929994 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6229eb9b-1c01-4e24-8d11-3847df26e4ee tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:12:32.930429 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6229eb9b-1c01-4e24-8d11-3847df26e4ee tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:12:33.064414 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-6229eb9b-1c01-4e24-8d11-3847df26e4ee tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:12:33.071845 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-6229eb9b-1c01-4e24-8d11-3847df26e4ee tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/dff45473-c8cb-40c9-8cbb-bc98056c340a" status: 200 len: 1364 microversion: 2.1 time: 0.154692 Jul 21 20:12:33.073978 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 400/779] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:12:32 2022] GET /compute/v2.1/servers/dff45473-c8cb-40c9-8cbb-bc98056c340a => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:12:34.089318 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-e14ec4f3-1bff-4f22-9d44-8cc019415de3 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:12:34.089933 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-e14ec4f3-1bff-4f22-9d44-8cc019415de3 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: dff45473-c8cb-40c9-8cbb-bc98056c340a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:12:34.097079 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-e14ec4f3-1bff-4f22-9d44-8cc019415de3 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:12:34.097526 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-e14ec4f3-1bff-4f22-9d44-8cc019415de3 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:12:34.098299 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-e14ec4f3-1bff-4f22-9d44-8cc019415de3 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:12:34.098735 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-e14ec4f3-1bff-4f22-9d44-8cc019415de3 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:12:34.231381 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-e14ec4f3-1bff-4f22-9d44-8cc019415de3 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:12:34.238830 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-e14ec4f3-1bff-4f22-9d44-8cc019415de3 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/dff45473-c8cb-40c9-8cbb-bc98056c340a" status: 200 len: 1364 microversion: 2.1 time: 0.153531 Jul 21 20:12:34.239435 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 380/780] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:12:34 2022] GET /compute/v2.1/servers/dff45473-c8cb-40c9-8cbb-bc98056c340a => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:12:35.256384 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-319dd8ff-6520-4abd-80a1-1157162a53ed tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:12:35.256980 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-319dd8ff-6520-4abd-80a1-1157162a53ed tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: dff45473-c8cb-40c9-8cbb-bc98056c340a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:12:35.264213 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-319dd8ff-6520-4abd-80a1-1157162a53ed tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:12:35.264665 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-319dd8ff-6520-4abd-80a1-1157162a53ed tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:12:35.265501 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-319dd8ff-6520-4abd-80a1-1157162a53ed tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:12:35.265883 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-319dd8ff-6520-4abd-80a1-1157162a53ed tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:12:35.395292 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-319dd8ff-6520-4abd-80a1-1157162a53ed tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:12:35.402764 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-319dd8ff-6520-4abd-80a1-1157162a53ed tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/dff45473-c8cb-40c9-8cbb-bc98056c340a" status: 200 len: 1364 microversion: 2.1 time: 0.150581 Jul 21 20:12:35.404201 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 401/781] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:12:35 2022] GET /compute/v2.1/servers/dff45473-c8cb-40c9-8cbb-bc98056c340a => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:12:36.202502 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [req-5f6dd9d6-747d-4501-879f-c6a1cb7220a2 req-c64893ee-df5b-4a6b-a9f8-1257c2f09da2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dff45473-c8cb-40c9-8cbb-bc98056c340a", "name": "network-vif-plugged", "status": "completed", "tag": "90b14516-2737-470e-87c1-cc22ffa351fc"}]} {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:12:36.211013 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [req-5f6dd9d6-747d-4501-879f-c6a1cb7220a2 req-c64893ee-df5b-4a6b-a9f8-1257c2f09da2 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:12:36.211517 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [req-5f6dd9d6-747d-4501-879f-c6a1cb7220a2 req-c64893ee-df5b-4a6b-a9f8-1257c2f09da2 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:12:36.222607 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.compute.server_external_events [req-5f6dd9d6-747d-4501-879f-c6a1cb7220a2 req-c64893ee-df5b-4a6b-a9f8-1257c2f09da2 service nova] Creating event network-vif-plugged:90b14516-2737-470e-87c1-cc22ffa351fc for instance dff45473-c8cb-40c9-8cbb-bc98056c340a on hv-cinder-85054 Jul 21 20:12:36.227564 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [req-5f6dd9d6-747d-4501-879f-c6a1cb7220a2 req-c64893ee-df5b-4a6b-a9f8-1257c2f09da2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028682 Jul 21 20:12:36.228140 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 381/782] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 20:12:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:12:36.420962 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-d6919773-9c15-41fa-aed4-d72d46c15e79 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:12:36.424852 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-d6919773-9c15-41fa-aed4-d72d46c15e79 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: dff45473-c8cb-40c9-8cbb-bc98056c340a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:12:36.427973 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d6919773-9c15-41fa-aed4-d72d46c15e79 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:12:36.428415 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d6919773-9c15-41fa-aed4-d72d46c15e79 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:12:36.429184 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d6919773-9c15-41fa-aed4-d72d46c15e79 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:12:36.429621 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d6919773-9c15-41fa-aed4-d72d46c15e79 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:12:36.561751 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-d6919773-9c15-41fa-aed4-d72d46c15e79 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:12:36.569881 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-d6919773-9c15-41fa-aed4-d72d46c15e79 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/dff45473-c8cb-40c9-8cbb-bc98056c340a" status: 200 len: 1364 microversion: 2.1 time: 0.152809 Jul 21 20:12:36.570505 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 402/783] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:12:36 2022] GET /compute/v2.1/servers/dff45473-c8cb-40c9-8cbb-bc98056c340a => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:12:37.588434 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-4d01ee2e-4b9a-412b-a12a-983494dbe593 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:12:37.589119 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-4d01ee2e-4b9a-412b-a12a-983494dbe593 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: dff45473-c8cb-40c9-8cbb-bc98056c340a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:12:37.595287 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-4d01ee2e-4b9a-412b-a12a-983494dbe593 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:12:37.595729 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-4d01ee2e-4b9a-412b-a12a-983494dbe593 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:12:37.596755 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-4d01ee2e-4b9a-412b-a12a-983494dbe593 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:12:37.597182 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-4d01ee2e-4b9a-412b-a12a-983494dbe593 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:12:37.725816 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-4d01ee2e-4b9a-412b-a12a-983494dbe593 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:12:37.733315 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-4d01ee2e-4b9a-412b-a12a-983494dbe593 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/dff45473-c8cb-40c9-8cbb-bc98056c340a" status: 200 len: 1364 microversion: 2.1 time: 0.150214 Jul 21 20:12:37.733883 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 382/784] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:12:37 2022] GET /compute/v2.1/servers/dff45473-c8cb-40c9-8cbb-bc98056c340a => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:12:38.750127 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-bdb96033-b4d1-48ba-bc3a-5d7ab15469ef tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:12:38.750738 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-bdb96033-b4d1-48ba-bc3a-5d7ab15469ef tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: dff45473-c8cb-40c9-8cbb-bc98056c340a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:12:38.756897 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-bdb96033-b4d1-48ba-bc3a-5d7ab15469ef tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:12:38.757341 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-bdb96033-b4d1-48ba-bc3a-5d7ab15469ef tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:12:38.758108 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-bdb96033-b4d1-48ba-bc3a-5d7ab15469ef tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:12:38.758537 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-bdb96033-b4d1-48ba-bc3a-5d7ab15469ef tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:12:38.890562 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-bdb96033-b4d1-48ba-bc3a-5d7ab15469ef tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:12:38.898018 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-bdb96033-b4d1-48ba-bc3a-5d7ab15469ef tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/dff45473-c8cb-40c9-8cbb-bc98056c340a" status: 200 len: 1549 microversion: 2.1 time: 0.151791 Jul 21 20:12:38.898572 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 403/785] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:12:38 2022] GET /compute/v2.1/servers/dff45473-c8cb-40c9-8cbb-bc98056c340a => generated 1549 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:12:38.914537 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-1d5c6dfa-3be8-4adf-93b8-479524d6e98a tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:12:38.915084 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-1d5c6dfa-3be8-4adf-93b8-479524d6e98a tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: dff45473-c8cb-40c9-8cbb-bc98056c340a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:12:38.922136 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-1d5c6dfa-3be8-4adf-93b8-479524d6e98a tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:12:38.922583 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-1d5c6dfa-3be8-4adf-93b8-479524d6e98a tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:12:38.923488 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-1d5c6dfa-3be8-4adf-93b8-479524d6e98a tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:12:38.923916 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-1d5c6dfa-3be8-4adf-93b8-479524d6e98a tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:12:38.927574 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG dbcounter [-] [118344] Writing DB stats nova_cell1:SELECT=88 {{(pid=118344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:12:39.001976 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-1d5c6dfa-3be8-4adf-93b8-479524d6e98a tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/dff45473-c8cb-40c9-8cbb-bc98056c340a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091232 Jul 21 20:12:39.002582 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 383/786] 10.222.0.58 () {58 vars in 1274 bytes} [Thu Jul 21 20:12:38 2022] GET /compute/v2.1/servers/dff45473-c8cb-40c9-8cbb-bc98056c340a/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:12:40.042444 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [req-e2bec646-6d1e-4064-a619-f247dd6608f8 req-a319e248-aa2d-4ab9-bdd4-df4bd6152a96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dff45473-c8cb-40c9-8cbb-bc98056c340a", "tag": "90b14516-2737-470e-87c1-cc22ffa351fc"}]} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:12:40.045986 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:12:40.051161 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-e2bec646-6d1e-4064-a619-f247dd6608f8 req-a319e248-aa2d-4ab9-bdd4-df4bd6152a96 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:12:40.058407 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-e2bec646-6d1e-4064-a619-f247dd6608f8 req-a319e248-aa2d-4ab9-bdd4-df4bd6152a96 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:12:40.062865 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.compute.server_external_events [req-e2bec646-6d1e-4064-a619-f247dd6608f8 req-a319e248-aa2d-4ab9-bdd4-df4bd6152a96 service nova] Creating event network-changed:90b14516-2737-470e-87c1-cc22ffa351fc for instance dff45473-c8cb-40c9-8cbb-bc98056c340a on hv-cinder-85054 Jul 21 20:12:40.068043 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [req-e2bec646-6d1e-4064-a619-f247dd6608f8 req-a319e248-aa2d-4ab9-bdd4-df4bd6152a96 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029225 Jul 21 20:12:40.069403 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 404/787] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 20:12:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:13:27.725341 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG dbcounter [-] [118344] Writing DB stats nova_api:SELECT=11 {{(pid=118344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:13:27.726077 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG dbcounter [-] [118344] Writing DB stats nova_cell1:SELECT=3 {{(pid=118344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:13:27.730130 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-4fabca38-c61a-4b4c-8c4e-76dd522b6f21 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:13:27.730614 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-4fabca38-c61a-4b4c-8c4e-76dd522b6f21 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: a41559e0-1fb6-44ef-97c1-36025e52fc48] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:13:27.736998 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-4fabca38-c61a-4b4c-8c4e-76dd522b6f21 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:13:27.740301 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-4fabca38-c61a-4b4c-8c4e-76dd522b6f21 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:13:27.740301 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-4fabca38-c61a-4b4c-8c4e-76dd522b6f21 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:13:27.740301 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-4fabca38-c61a-4b4c-8c4e-76dd522b6f21 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:13:27.761012 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-4fabca38-c61a-4b4c-8c4e-76dd522b6f21 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/a41559e0-1fb6-44ef-97c1-36025e52fc48/ips" status: 200 len: 150 microversion: 2.1 time: 0.037136 Jul 21 20:13:27.761563 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 384/788] 10.222.0.58 () {58 vars in 1247 bytes} [Thu Jul 21 20:13:27 2022] GET /compute/v2.1/servers/a41559e0-1fb6-44ef-97c1-36025e52fc48/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:13:28.051429 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell1:SELECT=47 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:13:28.056034 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-d6c5491d-6683-4043-a2db-8261ae47b8b3 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:13:28.056604 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-d6c5491d-6683-4043-a2db-8261ae47b8b3 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: 5610f3fc-4e8b-48c0-a628-4b5c9419635a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:13:28.062867 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d6c5491d-6683-4043-a2db-8261ae47b8b3 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:13:28.063715 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d6c5491d-6683-4043-a2db-8261ae47b8b3 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:13:28.064147 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d6c5491d-6683-4043-a2db-8261ae47b8b3 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:13:28.064578 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d6c5491d-6683-4043-a2db-8261ae47b8b3 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:13:28.087888 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-d6c5491d-6683-4043-a2db-8261ae47b8b3 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a/ips" status: 200 len: 151 microversion: 2.20 time: 0.037573 Jul 21 20:13:28.094369 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 405/789] 10.222.0.58 () {60 vars in 1288 bytes} [Thu Jul 21 20:13:28 2022] GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 20:13:33.965918 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-8b6170f8-ade2-444c-874c-88985597156e tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7974ebb5-98a7-4731-96a3-d90b95f746f8"}} {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:13:33.967042 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-8b6170f8-ade2-444c-874c-88985597156e tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: a41559e0-1fb6-44ef-97c1-36025e52fc48] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:13:33.973953 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-8b6170f8-ade2-444c-874c-88985597156e tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:13:33.974399 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-8b6170f8-ade2-444c-874c-88985597156e tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:13:33.975189 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-8b6170f8-ade2-444c-874c-88985597156e tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:13:33.975629 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-8b6170f8-ade2-444c-874c-88985597156e tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:13:34.621590 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-5d913330-6da0-4d7b-9e71-2442e177aacc tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:13:34.622218 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-5d913330-6da0-4d7b-9e71-2442e177aacc tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: 5610f3fc-4e8b-48c0-a628-4b5c9419635a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:13:34.630229 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5d913330-6da0-4d7b-9e71-2442e177aacc tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:13:34.630840 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5d913330-6da0-4d7b-9e71-2442e177aacc tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:13:34.631799 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5d913330-6da0-4d7b-9e71-2442e177aacc tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:13:34.632236 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5d913330-6da0-4d7b-9e71-2442e177aacc tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:13:34.655124 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.objects.instance [None req-5d913330-6da0-4d7b-9e71-2442e177aacc tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lazy-loading 'flavor' on Instance uuid 5610f3fc-4e8b-48c0-a628-4b5c9419635a {{(pid=118345) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 20:13:34.877040 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-8b6170f8-ade2-444c-874c-88985597156e tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "POST /compute/v2.1/servers/a41559e0-1fb6-44ef-97c1-36025e52fc48/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.914802 Jul 21 20:13:34.878201 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 385/790] 10.222.0.58 () {60 vars in 1322 bytes} [Thu Jul 21 20:13:33 2022] POST /compute/v2.1/servers/a41559e0-1fb6-44ef-97c1-36025e52fc48/os-volume_attachments => generated 194 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:13:35.271132 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-5d913330-6da0-4d7b-9e71-2442e177aacc tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "POST /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a/action" status: 202 len: 0 microversion: 2.20 time: 0.653893 Jul 21 20:13:35.271755 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 406/791] 10.222.0.58 () {62 vars in 1318 bytes} [Thu Jul 21 20:13:34 2022] POST /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a/action => generated 0 bytes in 655 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 21 20:13:35.281455 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-7f747bfe-9519-4d4a-81be-9ae477ee8273 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:13:35.282394 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-7f747bfe-9519-4d4a-81be-9ae477ee8273 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: 5610f3fc-4e8b-48c0-a628-4b5c9419635a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:13:35.289270 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-7f747bfe-9519-4d4a-81be-9ae477ee8273 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:13:35.289722 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-7f747bfe-9519-4d4a-81be-9ae477ee8273 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:13:35.290493 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-7f747bfe-9519-4d4a-81be-9ae477ee8273 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:13:35.291055 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-7f747bfe-9519-4d4a-81be-9ae477ee8273 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:13:35.429009 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-7f747bfe-9519-4d4a-81be-9ae477ee8273 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:13:35.437882 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-7f747bfe-9519-4d4a-81be-9ae477ee8273 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:13:35.439346 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-7f747bfe-9519-4d4a-81be-9ae477ee8273 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:13:35.440523 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-7f747bfe-9519-4d4a-81be-9ae477ee8273 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a" status: 200 len: 1724 microversion: 2.20 time: 0.163628 Jul 21 20:13:35.441149 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 386/792] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:13:35 2022] GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:13:36.460250 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-3dfd0f60-fa78-49d8-8a60-24c25c2b71a6 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:13:36.460931 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-3dfd0f60-fa78-49d8-8a60-24c25c2b71a6 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: 5610f3fc-4e8b-48c0-a628-4b5c9419635a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:13:36.467253 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3dfd0f60-fa78-49d8-8a60-24c25c2b71a6 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:13:36.467686 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3dfd0f60-fa78-49d8-8a60-24c25c2b71a6 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:13:36.469044 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3dfd0f60-fa78-49d8-8a60-24c25c2b71a6 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:13:36.469468 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3dfd0f60-fa78-49d8-8a60-24c25c2b71a6 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:13:36.601128 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-3dfd0f60-fa78-49d8-8a60-24c25c2b71a6 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:13:36.609164 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-3dfd0f60-fa78-49d8-8a60-24c25c2b71a6 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:13:36.610664 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-3dfd0f60-fa78-49d8-8a60-24c25c2b71a6 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:13:36.611847 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-3dfd0f60-fa78-49d8-8a60-24c25c2b71a6 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a" status: 200 len: 1724 microversion: 2.20 time: 0.155962 Jul 21 20:13:36.612401 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 407/793] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:13:36 2022] GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:13:37.631573 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-fd2d55b8-e05e-4d77-9df5-5ff5ffbc684e tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:13:37.632208 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-fd2d55b8-e05e-4d77-9df5-5ff5ffbc684e tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: 5610f3fc-4e8b-48c0-a628-4b5c9419635a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:13:37.639477 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-fd2d55b8-e05e-4d77-9df5-5ff5ffbc684e tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:13:37.639955 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-fd2d55b8-e05e-4d77-9df5-5ff5ffbc684e tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:13:37.641201 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-fd2d55b8-e05e-4d77-9df5-5ff5ffbc684e tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:13:37.641201 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-fd2d55b8-e05e-4d77-9df5-5ff5ffbc684e tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:13:37.772185 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-fd2d55b8-e05e-4d77-9df5-5ff5ffbc684e tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:13:37.780135 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-fd2d55b8-e05e-4d77-9df5-5ff5ffbc684e tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:13:37.781682 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-fd2d55b8-e05e-4d77-9df5-5ff5ffbc684e tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:13:37.782819 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-fd2d55b8-e05e-4d77-9df5-5ff5ffbc684e tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a" status: 200 len: 1724 microversion: 2.20 time: 0.156065 Jul 21 20:13:37.783405 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 387/794] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:13:37 2022] GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:13:38.800842 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-992f1ef4-ecb1-46fa-9b36-1f3b75d6fad8 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:13:38.801472 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-992f1ef4-ecb1-46fa-9b36-1f3b75d6fad8 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: 5610f3fc-4e8b-48c0-a628-4b5c9419635a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:13:38.807593 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-992f1ef4-ecb1-46fa-9b36-1f3b75d6fad8 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:13:38.808040 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-992f1ef4-ecb1-46fa-9b36-1f3b75d6fad8 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:13:38.808851 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-992f1ef4-ecb1-46fa-9b36-1f3b75d6fad8 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:13:38.809285 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-992f1ef4-ecb1-46fa-9b36-1f3b75d6fad8 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:13:38.943550 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-992f1ef4-ecb1-46fa-9b36-1f3b75d6fad8 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:13:38.951854 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-992f1ef4-ecb1-46fa-9b36-1f3b75d6fad8 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:13:38.953933 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-992f1ef4-ecb1-46fa-9b36-1f3b75d6fad8 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:13:38.955196 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-992f1ef4-ecb1-46fa-9b36-1f3b75d6fad8 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a" status: 200 len: 1724 microversion: 2.20 time: 0.158755 Jul 21 20:13:38.955763 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 408/795] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:13:38 2022] GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:13:39.973453 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-b26c8a0e-193f-4f3a-95b9-81777e3b81a6 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:13:39.974005 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-b26c8a0e-193f-4f3a-95b9-81777e3b81a6 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: 5610f3fc-4e8b-48c0-a628-4b5c9419635a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:13:39.980725 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-b26c8a0e-193f-4f3a-95b9-81777e3b81a6 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:13:39.981164 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-b26c8a0e-193f-4f3a-95b9-81777e3b81a6 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:13:39.981941 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-b26c8a0e-193f-4f3a-95b9-81777e3b81a6 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:13:39.982366 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-b26c8a0e-193f-4f3a-95b9-81777e3b81a6 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:13:40.113473 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-b26c8a0e-193f-4f3a-95b9-81777e3b81a6 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:13:40.121682 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-b26c8a0e-193f-4f3a-95b9-81777e3b81a6 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:13:40.123210 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-b26c8a0e-193f-4f3a-95b9-81777e3b81a6 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:13:40.124408 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-b26c8a0e-193f-4f3a-95b9-81777e3b81a6 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a" status: 200 len: 1724 microversion: 2.20 time: 0.155164 Jul 21 20:13:40.124958 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 388/796] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:13:39 2022] GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:13:41.142943 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-4c7ee665-422c-4d44-8164-11d2cb05eec9 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:13:41.152329 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-4c7ee665-422c-4d44-8164-11d2cb05eec9 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: 5610f3fc-4e8b-48c0-a628-4b5c9419635a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:13:41.152329 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4c7ee665-422c-4d44-8164-11d2cb05eec9 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:13:41.152329 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4c7ee665-422c-4d44-8164-11d2cb05eec9 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:13:41.152329 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4c7ee665-422c-4d44-8164-11d2cb05eec9 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:13:41.152814 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4c7ee665-422c-4d44-8164-11d2cb05eec9 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:13:41.289377 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-4c7ee665-422c-4d44-8164-11d2cb05eec9 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:13:41.298066 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-4c7ee665-422c-4d44-8164-11d2cb05eec9 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:13:41.299639 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-4c7ee665-422c-4d44-8164-11d2cb05eec9 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:13:41.300802 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-4c7ee665-422c-4d44-8164-11d2cb05eec9 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a" status: 200 len: 1724 microversion: 2.20 time: 0.162435 Jul 21 20:13:41.301361 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 409/797] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:13:41 2022] GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:13:42.318808 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-374ebb8e-acc2-4e7b-8b96-9a69beebcbcf tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:13:42.319437 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-374ebb8e-acc2-4e7b-8b96-9a69beebcbcf tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: 5610f3fc-4e8b-48c0-a628-4b5c9419635a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:13:42.325535 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-374ebb8e-acc2-4e7b-8b96-9a69beebcbcf tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:13:42.336999 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-374ebb8e-acc2-4e7b-8b96-9a69beebcbcf tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:13:42.336999 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-374ebb8e-acc2-4e7b-8b96-9a69beebcbcf tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:13:42.336999 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-374ebb8e-acc2-4e7b-8b96-9a69beebcbcf tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:13:42.460707 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-374ebb8e-acc2-4e7b-8b96-9a69beebcbcf tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:13:42.471731 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-374ebb8e-acc2-4e7b-8b96-9a69beebcbcf tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:13:42.471731 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-374ebb8e-acc2-4e7b-8b96-9a69beebcbcf tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:13:42.471731 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-374ebb8e-acc2-4e7b-8b96-9a69beebcbcf tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a" status: 200 len: 1724 microversion: 2.20 time: 0.156454 Jul 21 20:13:42.472328 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 389/798] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:13:42 2022] GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:13:43.427030 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-366f8eb7-f1e6-4915-81b9-9967fa00d846 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7974ebb5-98a7-4731-96a3-d90b95f746f8"}} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:13:43.428177 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-366f8eb7-f1e6-4915-81b9-9967fa00d846 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: a41559e0-1fb6-44ef-97c1-36025e52fc48] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:13:43.434500 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-366f8eb7-f1e6-4915-81b9-9967fa00d846 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:13:43.434938 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-366f8eb7-f1e6-4915-81b9-9967fa00d846 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:13:43.435883 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-366f8eb7-f1e6-4915-81b9-9967fa00d846 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:13:43.436314 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-366f8eb7-f1e6-4915-81b9-9967fa00d846 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:13:43.490138 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-ed249967-e016-4c56-bc93-f671ede2445d tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:13:43.490837 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-ed249967-e016-4c56-bc93-f671ede2445d tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: 5610f3fc-4e8b-48c0-a628-4b5c9419635a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:13:43.497398 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-ed249967-e016-4c56-bc93-f671ede2445d tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:13:43.497850 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-ed249967-e016-4c56-bc93-f671ede2445d tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:13:43.498679 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-ed249967-e016-4c56-bc93-f671ede2445d tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:13:43.499141 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-ed249967-e016-4c56-bc93-f671ede2445d tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:13:43.518051 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.wsgi [None req-366f8eb7-f1e6-4915-81b9-9967fa00d846 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] HTTP exception thrown: Invalid volume: volume 7974ebb5-98a7-4731-96a3-d90b95f746f8 is already attached to instances: a41559e0-1fb6-44ef-97c1-36025e52fc48 Jul 21 20:13:43.519906 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-366f8eb7-f1e6-4915-81b9-9967fa00d846 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Request method failure captured: Jul 21 20:13:43.519906 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: request: POST /compute/v2.1/servers/a41559e0-1fb6-44ef-97c1-36025e52fc48/os-volume_attachments HTTP/1.1 Jul 21 20:13:43.519906 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Accept: application/json Jul 21 20:13:43.519906 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Accept-Encoding: identity Jul 21 20:13:43.519906 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Connection: close Jul 21 20:13:43.519906 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Content-Length: 74 Jul 21 20:13:43.519906 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Content-Type: application/json Jul 21 20:13:43.519906 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Host: 10.222.0.58 Jul 21 20:13:43.519906 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Openstack-System-Scope: None Jul 21 20:13:43.519906 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: User-Agent: python-urllib3/1.26.9 Jul 21 20:13:43.519906 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Auth-Token: gAAAAABi2bFjKCUxQrNdZsEJV1kBJFiLgTT1Ekl7oj8yg_h_7YxyA7duEHuPdhQkp4Jd1ksQT4I6f50cht2hanCT9gvKpkDXVC1Uog_MnmqMteApPkGCv4CO2lrQc2eP7fSnvkh1csaG9QP2Dj0psWvWObuaYy8zQZsTJEhGK2eg_fgoqVDBHDI Jul 21 20:13:43.519906 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Domain-Id: None Jul 21 20:13:43.519906 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Domain-Name: None Jul 21 20:13:43.519906 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Identity-Status: Confirmed Jul 21 20:13:43.519906 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Is-Admin-Project: True Jul 21 20:13:43.519906 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Id: default Jul 21 20:13:43.519906 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Name: Default Jul 21 20:13:43.519906 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Id: e0075f5ba84547c782504d23f6029fd2 Jul 21 20:13:43.519906 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Name: tempest-AttachVolumeNegativeTest-1294836183 Jul 21 20:13:43.519906 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Role: reader,member Jul 21 20:13:43.519906 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Roles: reader,member Jul 21 20:13:43.521562 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e0075f5ba84547c782504d23f6029fd2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e0075f5ba84547c782504d23f6029fd2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e0075f5ba84547c782504d23f6029fd2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e0075f5ba84547c782504d23f6029fd2"}]}] Jul 21 20:13:43.521562 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Tenant: tempest-AttachVolumeNegativeTest-1294836183 Jul 21 20:13:43.521562 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Tenant-Id: e0075f5ba84547c782504d23f6029fd2 Jul 21 20:13:43.521562 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1294836183 Jul 21 20:13:43.521562 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User: tempest-AttachVolumeNegativeTest-1294836183-project Jul 21 20:13:43.521562 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Id: default Jul 21 20:13:43.521562 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Name: Default Jul 21 20:13:43.521562 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Id: d04a0e68aea7424181f6c2728cbf7e3f Jul 21 20:13:43.521562 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Name: tempest-AttachVolumeNegativeTest-1294836183-project Jul 21 20:13:43.521562 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Jul 21 20:13:43.521562 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: {"volumeAttachment": {"volumeId": "7974ebb5-98a7-4731-96a3-d90b95f746f8"}} Jul 21 20:13:43.521562 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: method: > Jul 21 20:13:43.523979 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: exception: Invalid volume: volume 7974ebb5-98a7-4731-96a3-d90b95f746f8 is already attached to instances: a41559e0-1fb6-44ef-97c1-36025e52fc48 Jul 21 20:13:43.523979 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: action_args: {'server_id': 'a41559e0-1fb6-44ef-97c1-36025e52fc48', 'body': {'volumeAttachment': {'volumeId': '7974ebb5-98a7-4731-96a3-d90b95f746f8'}}} Jul 21 20:13:43.523979 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 20:13:43.523979 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:13:43.523979 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 21 20:13:43.523979 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 21 20:13:43.523979 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 21 20:13:43.523979 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 21 20:13:43.523979 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 21 20:13:43.523979 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 21 20:13:43.523979 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 21 20:13:43.523979 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 21 20:13:43.523979 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 21 20:13:43.523979 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 21 20:13:43.523979 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 7974ebb5-98a7-4731-96a3-d90b95f746f8 is already attached to instances: a41559e0-1fb6-44ef-97c1-36025e52fc48 Jul 21 20:13:43.523979 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:13:43.523979 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:13:43.523979 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:13:43.523979 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:13:43.525374 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:13:43.525374 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:13:43.525374 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 20:13:43.525374 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 20:13:43.525374 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 20:13:43.525374 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 20:13:43.525374 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 21 20:13:43.525374 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 20:13:43.525374 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 21 20:13:43.525374 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 20:13:43.525374 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 21 20:13:43.525374 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 20:13:43.525374 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 21 20:13:43.525374 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 21 20:13:43.525374 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 7974ebb5-98a7-4731-96a3-d90b95f746f8 is already attached to instances: a41559e0-1fb6-44ef-97c1-36025e52fc48 Jul 21 20:13:43.525374 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:13:43.525374 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:13:43.525374 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:13:43.525374 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:13:43.525374 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:13:43.527267 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:13:43.527267 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 20:13:43.527267 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 20:13:43.527267 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 7974ebb5-98a7-4731-96a3-d90b95f746f8 is already attached to instances: a41559e0-1fb6-44ef-97c1-36025e52fc48 Jul 21 20:13:43.527267 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:13:43.527267 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-366f8eb7-f1e6-4915-81b9-9967fa00d846 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Returning 400 to user: Invalid volume: volume 7974ebb5-98a7-4731-96a3-d90b95f746f8 is already attached to instances: a41559e0-1fb6-44ef-97c1-36025e52fc48 {{(pid=118345) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 20:13:43.527267 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-366f8eb7-f1e6-4915-81b9-9967fa00d846 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "POST /compute/v2.1/servers/a41559e0-1fb6-44ef-97c1-36025e52fc48/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099857 Jul 21 20:13:43.527267 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 410/799] 10.222.0.58 () {60 vars in 1322 bytes} [Thu Jul 21 20:13:43 2022] POST /compute/v2.1/servers/a41559e0-1fb6-44ef-97c1-36025e52fc48/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 21 20:13:43.606036 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-c31ccec1-3a2d-4324-b947-230d4d0b9ee8 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:13:43.606543 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-c31ccec1-3a2d-4324-b947-230d4d0b9ee8 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: a41559e0-1fb6-44ef-97c1-36025e52fc48] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:13:43.617302 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c31ccec1-3a2d-4324-b947-230d4d0b9ee8 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:13:43.617765 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c31ccec1-3a2d-4324-b947-230d4d0b9ee8 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:13:43.618548 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c31ccec1-3a2d-4324-b947-230d4d0b9ee8 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:13:43.618976 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c31ccec1-3a2d-4324-b947-230d4d0b9ee8 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:13:43.648932 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-ed249967-e016-4c56-bc93-f671ede2445d tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:13:43.657273 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-ed249967-e016-4c56-bc93-f671ede2445d tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:13:43.658796 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-ed249967-e016-4c56-bc93-f671ede2445d tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:13:43.659985 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-ed249967-e016-4c56-bc93-f671ede2445d tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a" status: 200 len: 1724 microversion: 2.20 time: 0.173780 Jul 21 20:13:43.660547 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 390/800] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:13:43 2022] GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 20:13:43.701624 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.objects.instance [None req-c31ccec1-3a2d-4324-b947-230d4d0b9ee8 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lazy-loading 'services' on Instance uuid a41559e0-1fb6-44ef-97c1-36025e52fc48 {{(pid=118345) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 20:13:44.056126 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-c31ccec1-3a2d-4324-b947-230d4d0b9ee8 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a41559e0-1fb6-44ef-97c1-36025e52fc48/os-volume_attachments/7974ebb5-98a7-4731-96a3-d90b95f746f8" status: 202 len: 0 microversion: 2.1 time: 0.453844 Jul 21 20:13:44.056918 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 411/801] 10.222.0.58 () {58 vars in 1415 bytes} [Thu Jul 21 20:13:43 2022] DELETE /compute/v2.1/servers/a41559e0-1fb6-44ef-97c1-36025e52fc48/os-volume_attachments/7974ebb5-98a7-4731-96a3-d90b95f746f8 => generated 0 bytes in 455 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 21 20:13:44.066445 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-d2e7efaa-fc3a-45f1-9409-2239d31f786e tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:13:44.067441 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-d2e7efaa-fc3a-45f1-9409-2239d31f786e tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: a41559e0-1fb6-44ef-97c1-36025e52fc48] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:13:44.073606 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-d2e7efaa-fc3a-45f1-9409-2239d31f786e tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:13:44.075065 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-d2e7efaa-fc3a-45f1-9409-2239d31f786e tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:13:44.080234 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-d2e7efaa-fc3a-45f1-9409-2239d31f786e tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:13:44.080234 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-d2e7efaa-fc3a-45f1-9409-2239d31f786e tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:13:44.107268 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-d2e7efaa-fc3a-45f1-9409-2239d31f786e tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/a41559e0-1fb6-44ef-97c1-36025e52fc48/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045271 Jul 21 20:13:44.111926 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 391/802] 10.222.0.58 () {58 vars in 1301 bytes} [Thu Jul 21 20:13:44 2022] GET /compute/v2.1/servers/a41559e0-1fb6-44ef-97c1-36025e52fc48/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:13:44.678840 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-3e2623b2-7bb1-4654-b65c-27ff23e94444 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:13:44.679664 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-3e2623b2-7bb1-4654-b65c-27ff23e94444 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: 5610f3fc-4e8b-48c0-a628-4b5c9419635a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:13:44.686777 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3e2623b2-7bb1-4654-b65c-27ff23e94444 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:13:44.693421 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3e2623b2-7bb1-4654-b65c-27ff23e94444 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:13:44.693421 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3e2623b2-7bb1-4654-b65c-27ff23e94444 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:13:44.693421 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3e2623b2-7bb1-4654-b65c-27ff23e94444 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:13:44.821547 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-3e2623b2-7bb1-4654-b65c-27ff23e94444 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:13:44.829683 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-3e2623b2-7bb1-4654-b65c-27ff23e94444 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:13:44.831309 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-3e2623b2-7bb1-4654-b65c-27ff23e94444 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:13:44.832446 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-3e2623b2-7bb1-4654-b65c-27ff23e94444 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a" status: 200 len: 1724 microversion: 2.20 time: 0.157973 Jul 21 20:13:44.832987 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 412/803] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:13:44 2022] GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:13:45.119740 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-677fa933-7f55-4fbd-b8d9-8c55e38306c3 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:13:45.120664 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-677fa933-7f55-4fbd-b8d9-8c55e38306c3 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: a41559e0-1fb6-44ef-97c1-36025e52fc48] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:13:45.127110 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-677fa933-7f55-4fbd-b8d9-8c55e38306c3 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:13:45.127561 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-677fa933-7f55-4fbd-b8d9-8c55e38306c3 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:13:45.128324 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-677fa933-7f55-4fbd-b8d9-8c55e38306c3 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:13:45.128757 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-677fa933-7f55-4fbd-b8d9-8c55e38306c3 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:13:45.158222 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-677fa933-7f55-4fbd-b8d9-8c55e38306c3 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/a41559e0-1fb6-44ef-97c1-36025e52fc48/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042486 Jul 21 20:13:45.158781 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 392/804] 10.222.0.58 () {58 vars in 1301 bytes} [Thu Jul 21 20:13:45 2022] GET /compute/v2.1/servers/a41559e0-1fb6-44ef-97c1-36025e52fc48/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:13:45.851526 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-714d3e10-df49-45c0-b54d-d0922933a3dd tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:13:45.852128 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-714d3e10-df49-45c0-b54d-d0922933a3dd tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: 5610f3fc-4e8b-48c0-a628-4b5c9419635a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:13:45.858105 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-714d3e10-df49-45c0-b54d-d0922933a3dd tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:13:45.859099 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-714d3e10-df49-45c0-b54d-d0922933a3dd tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:13:45.859898 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-714d3e10-df49-45c0-b54d-d0922933a3dd tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:13:45.860319 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-714d3e10-df49-45c0-b54d-d0922933a3dd tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:13:45.993882 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-714d3e10-df49-45c0-b54d-d0922933a3dd tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:13:46.002706 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-714d3e10-df49-45c0-b54d-d0922933a3dd tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:13:46.004363 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-714d3e10-df49-45c0-b54d-d0922933a3dd tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:13:46.013200 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-714d3e10-df49-45c0-b54d-d0922933a3dd tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a" status: 200 len: 1724 microversion: 2.20 time: 0.158005 Jul 21 20:13:46.013200 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 413/805] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:13:45 2022] GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:13:46.170284 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-4790e285-9953-481e-92f3-528ac022e3d7 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:13:46.171828 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-4790e285-9953-481e-92f3-528ac022e3d7 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: a41559e0-1fb6-44ef-97c1-36025e52fc48] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:13:46.178396 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-4790e285-9953-481e-92f3-528ac022e3d7 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:13:46.178846 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-4790e285-9953-481e-92f3-528ac022e3d7 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:13:46.179654 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-4790e285-9953-481e-92f3-528ac022e3d7 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:13:46.180089 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-4790e285-9953-481e-92f3-528ac022e3d7 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:13:46.209457 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-4790e285-9953-481e-92f3-528ac022e3d7 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/a41559e0-1fb6-44ef-97c1-36025e52fc48/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043537 Jul 21 20:13:46.210030 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 393/806] 10.222.0.58 () {58 vars in 1301 bytes} [Thu Jul 21 20:13:46 2022] GET /compute/v2.1/servers/a41559e0-1fb6-44ef-97c1-36025e52fc48/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 21 20:13:46.267048 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-f6cb3bc5-3c4a-4762-a346-d318c96e6c15 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:13:46.267551 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-f6cb3bc5-3c4a-4762-a346-d318c96e6c15 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: a41559e0-1fb6-44ef-97c1-36025e52fc48] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:13:46.273426 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f6cb3bc5-3c4a-4762-a346-d318c96e6c15 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:13:46.273878 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f6cb3bc5-3c4a-4762-a346-d318c96e6c15 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:13:46.274642 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f6cb3bc5-3c4a-4762-a346-d318c96e6c15 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:13:46.275104 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f6cb3bc5-3c4a-4762-a346-d318c96e6c15 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:13:46.300976 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-f6cb3bc5-3c4a-4762-a346-d318c96e6c15 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: a41559e0-1fb6-44ef-97c1-36025e52fc48] Going to try to terminate instance {{(pid=118345) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 20:13:46.643289 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-f6cb3bc5-3c4a-4762-a346-d318c96e6c15 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a41559e0-1fb6-44ef-97c1-36025e52fc48" status: 204 len: 0 microversion: 2.1 time: 0.379720 Jul 21 20:13:46.643901 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 414/807] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Jul 21 20:13:46 2022] DELETE /compute/v2.1/servers/a41559e0-1fb6-44ef-97c1-36025e52fc48 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 20:13:46.652061 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-0bd4fe8a-487d-4c63-a5a3-2bb2ab846051 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:13:46.652891 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-0bd4fe8a-487d-4c63-a5a3-2bb2ab846051 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: a41559e0-1fb6-44ef-97c1-36025e52fc48] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:13:46.658874 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-0bd4fe8a-487d-4c63-a5a3-2bb2ab846051 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:13:46.659424 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-0bd4fe8a-487d-4c63-a5a3-2bb2ab846051 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:13:46.660175 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-0bd4fe8a-487d-4c63-a5a3-2bb2ab846051 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:13:46.660597 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-0bd4fe8a-487d-4c63-a5a3-2bb2ab846051 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:13:47.021777 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-0bd4fe8a-487d-4c63-a5a3-2bb2ab846051 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:13:47.025473 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-7a44296e-c399-429a-89b2-2be380d91865 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:13:47.026221 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-7a44296e-c399-429a-89b2-2be380d91865 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: 5610f3fc-4e8b-48c0-a628-4b5c9419635a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:13:47.029382 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-0bd4fe8a-487d-4c63-a5a3-2bb2ab846051 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/a41559e0-1fb6-44ef-97c1-36025e52fc48" status: 200 len: 1682 microversion: 2.1 time: 0.381124 Jul 21 20:13:47.029952 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 394/808] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:13:46 2022] GET /compute/v2.1/servers/a41559e0-1fb6-44ef-97c1-36025e52fc48 => generated 1682 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:13:47.032690 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-7a44296e-c399-429a-89b2-2be380d91865 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:13:47.033130 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-7a44296e-c399-429a-89b2-2be380d91865 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:13:47.033895 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-7a44296e-c399-429a-89b2-2be380d91865 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:13:47.034320 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-7a44296e-c399-429a-89b2-2be380d91865 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:13:47.164019 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-7a44296e-c399-429a-89b2-2be380d91865 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:13:47.172816 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-7a44296e-c399-429a-89b2-2be380d91865 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:13:47.174333 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-7a44296e-c399-429a-89b2-2be380d91865 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:13:47.175528 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-7a44296e-c399-429a-89b2-2be380d91865 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a" status: 200 len: 1724 microversion: 2.20 time: 0.154459 Jul 21 20:13:47.176081 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 415/809] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:13:47 2022] GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 20:13:48.047252 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-f0419ce9-be7d-4f49-992d-3348c6df50cb tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:13:48.051170 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-f0419ce9-be7d-4f49-992d-3348c6df50cb tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: a41559e0-1fb6-44ef-97c1-36025e52fc48] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:13:48.054688 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f0419ce9-be7d-4f49-992d-3348c6df50cb tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:13:48.055207 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f0419ce9-be7d-4f49-992d-3348c6df50cb tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:13:48.056014 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f0419ce9-be7d-4f49-992d-3348c6df50cb tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:13:48.056338 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f0419ce9-be7d-4f49-992d-3348c6df50cb tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:13:48.189904 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-f0419ce9-be7d-4f49-992d-3348c6df50cb tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:13:48.193592 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-4d575cca-8fa8-43f5-ba96-f42a53aeaf36 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:13:48.194205 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-4d575cca-8fa8-43f5-ba96-f42a53aeaf36 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: 5610f3fc-4e8b-48c0-a628-4b5c9419635a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:13:48.197655 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-f0419ce9-be7d-4f49-992d-3348c6df50cb tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/a41559e0-1fb6-44ef-97c1-36025e52fc48" status: 200 len: 1682 microversion: 2.1 time: 0.154836 Jul 21 20:13:48.200122 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 395/810] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:13:48 2022] GET /compute/v2.1/servers/a41559e0-1fb6-44ef-97c1-36025e52fc48 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:13:48.200351 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4d575cca-8fa8-43f5-ba96-f42a53aeaf36 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:13:48.200796 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4d575cca-8fa8-43f5-ba96-f42a53aeaf36 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:13:48.201574 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4d575cca-8fa8-43f5-ba96-f42a53aeaf36 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:13:48.202030 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4d575cca-8fa8-43f5-ba96-f42a53aeaf36 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:13:48.336076 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-4d575cca-8fa8-43f5-ba96-f42a53aeaf36 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:13:48.344667 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-4d575cca-8fa8-43f5-ba96-f42a53aeaf36 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:13:48.346447 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-4d575cca-8fa8-43f5-ba96-f42a53aeaf36 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:13:48.347627 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-4d575cca-8fa8-43f5-ba96-f42a53aeaf36 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a" status: 200 len: 1745 microversion: 2.20 time: 0.157882 Jul 21 20:13:48.348350 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 416/811] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:13:48 2022] GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a => generated 1745 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 20:13:49.215760 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-4d782cbb-288e-4fb3-8147-887abb034e3f tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:13:49.216486 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-4d782cbb-288e-4fb3-8147-887abb034e3f tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: a41559e0-1fb6-44ef-97c1-36025e52fc48] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:13:49.223600 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-4d782cbb-288e-4fb3-8147-887abb034e3f tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:13:49.224229 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-4d782cbb-288e-4fb3-8147-887abb034e3f tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:13:49.225140 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-4d782cbb-288e-4fb3-8147-887abb034e3f tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:13:49.225808 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-4d782cbb-288e-4fb3-8147-887abb034e3f tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:13:49.368378 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-4d782cbb-288e-4fb3-8147-887abb034e3f tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:13:49.368847 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-85e71dff-d68a-4806-89b7-8f35835739d5 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:13:49.369999 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-85e71dff-d68a-4806-89b7-8f35835739d5 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: 5610f3fc-4e8b-48c0-a628-4b5c9419635a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:13:49.377184 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-4d782cbb-288e-4fb3-8147-887abb034e3f tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/a41559e0-1fb6-44ef-97c1-36025e52fc48" status: 200 len: 1682 microversion: 2.1 time: 0.165746 Jul 21 20:13:49.378196 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-85e71dff-d68a-4806-89b7-8f35835739d5 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:13:49.379006 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-85e71dff-d68a-4806-89b7-8f35835739d5 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:13:49.380074 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-85e71dff-d68a-4806-89b7-8f35835739d5 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:13:49.380837 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-85e71dff-d68a-4806-89b7-8f35835739d5 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:13:49.387275 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 396/812] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:13:49 2022] GET /compute/v2.1/servers/a41559e0-1fb6-44ef-97c1-36025e52fc48 => generated 1682 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:13:49.413819 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:13:49.853587 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-85e71dff-d68a-4806-89b7-8f35835739d5 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:13:49.862060 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-85e71dff-d68a-4806-89b7-8f35835739d5 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:13:49.863746 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-85e71dff-d68a-4806-89b7-8f35835739d5 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:13:49.865087 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-85e71dff-d68a-4806-89b7-8f35835739d5 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a" status: 200 len: 1745 microversion: 2.20 time: 0.501430 Jul 21 20:13:49.865772 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 417/813] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:13:49 2022] GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a => generated 1745 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:13:50.013706 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [req-052afcd0-9510-47c7-bcd0-217df8e58705 req-558b45f1-e11e-46f2-9013-357154078846 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a41559e0-1fb6-44ef-97c1-36025e52fc48", "name": "network-vif-deleted", "tag": "5adf0c2c-829c-455c-8756-df9cea6504d6"}]} {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:13:50.022868 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [req-052afcd0-9510-47c7-bcd0-217df8e58705 req-558b45f1-e11e-46f2-9013-357154078846 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:13:50.023516 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [req-052afcd0-9510-47c7-bcd0-217df8e58705 req-558b45f1-e11e-46f2-9013-357154078846 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:13:50.035948 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.compute.server_external_events [req-052afcd0-9510-47c7-bcd0-217df8e58705 req-558b45f1-e11e-46f2-9013-357154078846 service nova] Creating event network-vif-deleted:5adf0c2c-829c-455c-8756-df9cea6504d6 for instance a41559e0-1fb6-44ef-97c1-36025e52fc48 on hv-cinder-85054 Jul 21 20:13:50.040950 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [req-052afcd0-9510-47c7-bcd0-217df8e58705 req-558b45f1-e11e-46f2-9013-357154078846 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031188 Jul 21 20:13:50.041904 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 397/814] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 20:13:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:13:50.394336 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-69dc0dba-77bc-4e04-92e1-5aafb8849ec6 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:13:50.395008 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-69dc0dba-77bc-4e04-92e1-5aafb8849ec6 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: a41559e0-1fb6-44ef-97c1-36025e52fc48] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:13:50.401208 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-69dc0dba-77bc-4e04-92e1-5aafb8849ec6 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:13:50.401655 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-69dc0dba-77bc-4e04-92e1-5aafb8849ec6 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:13:50.402457 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-69dc0dba-77bc-4e04-92e1-5aafb8849ec6 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:13:50.402884 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-69dc0dba-77bc-4e04-92e1-5aafb8849ec6 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:13:50.441470 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-69dc0dba-77bc-4e04-92e1-5aafb8849ec6 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:13:50.442319 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-69dc0dba-77bc-4e04-92e1-5aafb8849ec6 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:13:50.442628 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.objects.instance [None req-69dc0dba-77bc-4e04-92e1-5aafb8849ec6 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lazy-loading 'fault' on Instance uuid a41559e0-1fb6-44ef-97c1-36025e52fc48 {{(pid=118345) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 20:13:50.497020 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-69dc0dba-77bc-4e04-92e1-5aafb8849ec6 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:13:50.511496 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-69dc0dba-77bc-4e04-92e1-5aafb8849ec6 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/a41559e0-1fb6-44ef-97c1-36025e52fc48" status: 200 len: 1331 microversion: 2.1 time: 0.114948 Jul 21 20:13:50.511496 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 418/815] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:13:50 2022] GET /compute/v2.1/servers/a41559e0-1fb6-44ef-97c1-36025e52fc48 => generated 1331 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:13:50.884784 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-838aaff5-344c-4597-8eb2-e3c8e75adb73 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:13:50.885486 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-838aaff5-344c-4597-8eb2-e3c8e75adb73 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: 5610f3fc-4e8b-48c0-a628-4b5c9419635a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:13:50.892840 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-838aaff5-344c-4597-8eb2-e3c8e75adb73 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:13:50.893363 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-838aaff5-344c-4597-8eb2-e3c8e75adb73 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:13:50.894242 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-838aaff5-344c-4597-8eb2-e3c8e75adb73 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:13:50.894775 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-838aaff5-344c-4597-8eb2-e3c8e75adb73 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:13:51.033998 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-838aaff5-344c-4597-8eb2-e3c8e75adb73 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:13:51.044241 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-838aaff5-344c-4597-8eb2-e3c8e75adb73 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:13:51.047107 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-838aaff5-344c-4597-8eb2-e3c8e75adb73 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:13:51.048677 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-838aaff5-344c-4597-8eb2-e3c8e75adb73 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a" status: 200 len: 1745 microversion: 2.20 time: 0.168669 Jul 21 20:13:51.049334 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 398/816] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:13:50 2022] GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a => generated 1745 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:13:51.522717 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-f8890e4a-5b9e-46e7-bfe5-a0f26f2de957 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:13:51.523348 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-f8890e4a-5b9e-46e7-bfe5-a0f26f2de957 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: a41559e0-1fb6-44ef-97c1-36025e52fc48] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:13:51.529284 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f8890e4a-5b9e-46e7-bfe5-a0f26f2de957 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:13:51.529958 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f8890e4a-5b9e-46e7-bfe5-a0f26f2de957 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:13:51.531253 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f8890e4a-5b9e-46e7-bfe5-a0f26f2de957 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:13:51.531680 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f8890e4a-5b9e-46e7-bfe5-a0f26f2de957 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:13:51.544705 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.wsgi [None req-f8890e4a-5b9e-46e7-bfe5-a0f26f2de957 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] HTTP exception thrown: Instance a41559e0-1fb6-44ef-97c1-36025e52fc48 could not be found. Jul 21 20:13:51.546861 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-f8890e4a-5b9e-46e7-bfe5-a0f26f2de957 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Request method failure captured: Jul 21 20:13:51.546861 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: request: GET /compute/v2.1/servers/a41559e0-1fb6-44ef-97c1-36025e52fc48 HTTP/1.1 Jul 21 20:13:51.546861 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Accept: application/json Jul 21 20:13:51.546861 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Accept-Encoding: identity Jul 21 20:13:51.546861 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Connection: close Jul 21 20:13:51.546861 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Content-Length: 0 Jul 21 20:13:51.546861 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Content-Type: application/json Jul 21 20:13:51.546861 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Host: 10.222.0.58 Jul 21 20:13:51.546861 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Openstack-System-Scope: None Jul 21 20:13:51.546861 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: User-Agent: python-urllib3/1.26.9 Jul 21 20:13:51.546861 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Auth-Token: gAAAAABi2bFjKCUxQrNdZsEJV1kBJFiLgTT1Ekl7oj8yg_h_7YxyA7duEHuPdhQkp4Jd1ksQT4I6f50cht2hanCT9gvKpkDXVC1Uog_MnmqMteApPkGCv4CO2lrQc2eP7fSnvkh1csaG9QP2Dj0psWvWObuaYy8zQZsTJEhGK2eg_fgoqVDBHDI Jul 21 20:13:51.546861 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Domain-Id: None Jul 21 20:13:51.546861 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Domain-Name: None Jul 21 20:13:51.546861 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Identity-Status: Confirmed Jul 21 20:13:51.546861 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Is-Admin-Project: True Jul 21 20:13:51.546861 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Id: default Jul 21 20:13:51.546861 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Name: Default Jul 21 20:13:51.546861 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Id: e0075f5ba84547c782504d23f6029fd2 Jul 21 20:13:51.546861 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Name: tempest-AttachVolumeNegativeTest-1294836183 Jul 21 20:13:51.546861 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Role: reader,member Jul 21 20:13:51.546861 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Roles: reader,member Jul 21 20:13:51.548219 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e0075f5ba84547c782504d23f6029fd2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e0075f5ba84547c782504d23f6029fd2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e0075f5ba84547c782504d23f6029fd2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e0075f5ba84547c782504d23f6029fd2"}]}] Jul 21 20:13:51.548219 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Tenant: tempest-AttachVolumeNegativeTest-1294836183 Jul 21 20:13:51.548219 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Tenant-Id: e0075f5ba84547c782504d23f6029fd2 Jul 21 20:13:51.548219 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1294836183 Jul 21 20:13:51.548219 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User: tempest-AttachVolumeNegativeTest-1294836183-project Jul 21 20:13:51.548219 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Id: default Jul 21 20:13:51.548219 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Name: Default Jul 21 20:13:51.548219 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Id: d04a0e68aea7424181f6c2728cbf7e3f Jul 21 20:13:51.548219 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Name: tempest-AttachVolumeNegativeTest-1294836183-project Jul 21 20:13:51.548219 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: method: > Jul 21 20:13:51.548219 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: exception: Instance a41559e0-1fb6-44ef-97c1-36025e52fc48 could not be found. Jul 21 20:13:51.548219 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: action_args: {'id': 'a41559e0-1fb6-44ef-97c1-36025e52fc48'} Jul 21 20:13:51.549230 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 20:13:51.549230 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:13:51.549230 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 20:13:51.549230 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 20:13:51.549230 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 20:13:51.549230 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 20:13:51.549230 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 20:13:51.549230 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 20:13:51.549230 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 20:13:51.549230 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 20:13:51.549230 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a41559e0-1fb6-44ef-97c1-36025e52fc48 could not be found. Jul 21 20:13:51.549230 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:13:51.549230 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:13:51.549230 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:13:51.549230 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:13:51.549230 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:13:51.549230 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:13:51.549230 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 20:13:51.549230 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 20:13:51.549230 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 20:13:51.550402 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 20:13:51.550402 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 20:13:51.550402 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 20:13:51.550402 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 20:13:51.550402 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 20:13:51.550402 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 20:13:51.550402 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 20:13:51.550402 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a41559e0-1fb6-44ef-97c1-36025e52fc48 could not be found. Jul 21 20:13:51.550402 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:13:51.550402 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:13:51.550402 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:13:51.550402 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:13:51.550402 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:13:51.550402 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:13:51.550402 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 20:13:51.550402 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 20:13:51.550402 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a41559e0-1fb6-44ef-97c1-36025e52fc48 could not be found. Jul 21 20:13:51.550402 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:13:51.551494 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-f8890e4a-5b9e-46e7-bfe5-a0f26f2de957 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Returning 404 to user: Instance a41559e0-1fb6-44ef-97c1-36025e52fc48 could not be found. {{(pid=118345) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 20:13:51.551494 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-f8890e4a-5b9e-46e7-bfe5-a0f26f2de957 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/a41559e0-1fb6-44ef-97c1-36025e52fc48" status: 404 len: 111 microversion: 2.1 time: 0.029372 Jul 21 20:13:51.551494 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 419/817] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:13:51 2022] GET /compute/v2.1/servers/a41559e0-1fb6-44ef-97c1-36025e52fc48 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 20:13:51.557702 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-1f226929-6742-4fec-9263-75537333fe53 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '.version_select at 0x7f351cb72dc0>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:13:51.633909 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-1f226929-6742-4fec-9263-75537333fe53 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-200791007" status: 202 len: 0 microversion: 2.1 time: 0.079965 Jul 21 20:13:51.634489 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 399/818] 10.222.0.58 () {58 vars in 1217 bytes} [Thu Jul 21 20:13:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-200791007 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 20:13:52.067586 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-f13a953a-8e20-472c-b140-a56b81cceb94 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:13:52.068182 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-f13a953a-8e20-472c-b140-a56b81cceb94 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: 5610f3fc-4e8b-48c0-a628-4b5c9419635a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:13:52.073988 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f13a953a-8e20-472c-b140-a56b81cceb94 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:13:52.074425 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f13a953a-8e20-472c-b140-a56b81cceb94 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:13:52.075211 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f13a953a-8e20-472c-b140-a56b81cceb94 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:13:52.075640 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f13a953a-8e20-472c-b140-a56b81cceb94 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:13:52.281953 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-f13a953a-8e20-472c-b140-a56b81cceb94 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:13:52.292151 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-f13a953a-8e20-472c-b140-a56b81cceb94 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:13:52.295851 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-f13a953a-8e20-472c-b140-a56b81cceb94 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:13:52.295851 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-f13a953a-8e20-472c-b140-a56b81cceb94 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a" status: 200 len: 1745 microversion: 2.20 time: 0.231944 Jul 21 20:13:52.302231 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [req-5dc2f5a2-6f63-4667-93bf-dfc6ac756f36 req-24431f78-e705-48a5-8ff8-bb4fa9f1782b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5610f3fc-4e8b-48c0-a628-4b5c9419635a", "name": "network-vif-plugged", "status": "completed", "tag": "c9b7a4f8-5df1-449c-9157-130a564accea"}]} {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:13:52.307612 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 420/819] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:13:52 2022] GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a => generated 1745 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:13:52.315430 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [req-5dc2f5a2-6f63-4667-93bf-dfc6ac756f36 req-24431f78-e705-48a5-8ff8-bb4fa9f1782b service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:13:52.315891 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [req-5dc2f5a2-6f63-4667-93bf-dfc6ac756f36 req-24431f78-e705-48a5-8ff8-bb4fa9f1782b service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:13:52.326451 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.compute.server_external_events [req-5dc2f5a2-6f63-4667-93bf-dfc6ac756f36 req-24431f78-e705-48a5-8ff8-bb4fa9f1782b service nova] Creating event network-vif-plugged:c9b7a4f8-5df1-449c-9157-130a564accea for instance 5610f3fc-4e8b-48c0-a628-4b5c9419635a on hv-cinder-85054 Jul 21 20:13:52.331456 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [req-5dc2f5a2-6f63-4667-93bf-dfc6ac756f36 req-24431f78-e705-48a5-8ff8-bb4fa9f1782b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034538 Jul 21 20:13:52.332042 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 400/820] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 20:13:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:13:52.520094 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-4b7e947d-d7bf-4e4d-86e9-cdaffeb06d2c tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Action: 'create', calling method: .version_select at 0x7f351ccac8b0>, body: {"keypair": {"name": "tempest-keypair-2053320477", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ2HI/FfLDJgUAAu33F9L5YRpFYDxxrm/vu0dAdYBRDyHY9tdByhL2NFgySh+UwHS/vA74oYhuoFchVdsTJ4V+XGOasgXx4g7a69DfQp9sBGXyq20bflTDfYmTZR7ZbyBA=="}} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:13:52.534847 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.quota [None req-4b7e947d-d7bf-4e4d-86e9-cdaffeb06d2c tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Getting quotas for project e0075f5ba84547c782504d23f6029fd2. Resources: {'key_pairs'} {{(pid=118345) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 20:13:52.538618 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.quota [None req-4b7e947d-d7bf-4e4d-86e9-cdaffeb06d2c tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Getting quotas for user d04a0e68aea7424181f6c2728cbf7e3f and project e0075f5ba84547c782504d23f6029fd2. Resources: {'key_pairs'} {{(pid=118345) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 20:13:52.629537 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-4b7e947d-d7bf-4e4d-86e9-cdaffeb06d2c tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.107575 Jul 21 20:13:52.629537 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 421/821] 10.222.0.58 () {60 vars in 1158 bytes} [Thu Jul 21 20:13:52 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 20:13:53.315599 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-22d9e460-474e-4185-bffd-49d85f430ef2 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:13:53.316330 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-22d9e460-474e-4185-bffd-49d85f430ef2 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: 5610f3fc-4e8b-48c0-a628-4b5c9419635a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:13:53.324284 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-22d9e460-474e-4185-bffd-49d85f430ef2 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:13:53.324722 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-22d9e460-474e-4185-bffd-49d85f430ef2 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:13:53.325484 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-22d9e460-474e-4185-bffd-49d85f430ef2 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:13:53.325907 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-22d9e460-474e-4185-bffd-49d85f430ef2 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:13:53.456066 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-22d9e460-474e-4185-bffd-49d85f430ef2 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:13:53.459682 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG dbcounter [-] [118344] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:13:53.464477 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-22d9e460-474e-4185-bffd-49d85f430ef2 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:13:53.466126 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-22d9e460-474e-4185-bffd-49d85f430ef2 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:13:53.467319 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-22d9e460-474e-4185-bffd-49d85f430ef2 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a" status: 200 len: 1745 microversion: 2.20 time: 0.157296 Jul 21 20:13:53.467872 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 401/822] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:13:53 2022] GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a => generated 1745 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:13:54.485614 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-547a0603-2f7e-4fac-82eb-3d515cb2f553 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:13:54.486227 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-547a0603-2f7e-4fac-82eb-3d515cb2f553 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: 5610f3fc-4e8b-48c0-a628-4b5c9419635a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:13:54.492446 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-547a0603-2f7e-4fac-82eb-3d515cb2f553 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:13:54.492914 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-547a0603-2f7e-4fac-82eb-3d515cb2f553 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:13:54.493660 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-547a0603-2f7e-4fac-82eb-3d515cb2f553 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:13:54.494096 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-547a0603-2f7e-4fac-82eb-3d515cb2f553 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:13:54.632840 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-547a0603-2f7e-4fac-82eb-3d515cb2f553 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:13:54.641503 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-547a0603-2f7e-4fac-82eb-3d515cb2f553 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:13:54.643046 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-547a0603-2f7e-4fac-82eb-3d515cb2f553 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:13:54.644482 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-547a0603-2f7e-4fac-82eb-3d515cb2f553 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a" status: 200 len: 1745 microversion: 2.20 time: 0.162882 Jul 21 20:13:54.645537 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 422/823] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:13:54 2022] GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a => generated 1745 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:13:55.324699 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-09e741d8-d867-48a9-affc-9503098bb71b tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1316600915", "imageRef": "357a1479-6cbd-4882-8d3f-d945fa40e6df", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8c189c91-a136-44cc-8a4c-a42d0a4465fc"}], "security_groups": [{"name": "tempest-securitygroup--2042333575"}], "key_name": "tempest-keypair-2053320477", "user_data": "}} {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:13:55.426979 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.network.neutron [None req-09e741d8-d867-48a9-affc-9503098bb71b tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] validate_networks() for [('8c189c91-a136-44cc-8a4c-a42d0a4465fc', None, None, None, None, None)] {{(pid=118344) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 20:13:55.663070 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-ddcd4b4e-d136-4087-b0a7-54c44c22ab68 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:13:55.663680 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-ddcd4b4e-d136-4087-b0a7-54c44c22ab68 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: 5610f3fc-4e8b-48c0-a628-4b5c9419635a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:13:55.669689 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ddcd4b4e-d136-4087-b0a7-54c44c22ab68 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:13:55.670136 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ddcd4b4e-d136-4087-b0a7-54c44c22ab68 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:13:55.670981 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ddcd4b4e-d136-4087-b0a7-54c44c22ab68 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:13:55.671442 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ddcd4b4e-d136-4087-b0a7-54c44c22ab68 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:13:55.797201 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.virt.hardware [None req-09e741d8-d867-48a9-affc-9503098bb71b tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Flavor limits 0:0:0 {{(pid=118344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 20:13:55.814561 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.virt.hardware [None req-09e741d8-d867-48a9-affc-9503098bb71b tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Image limits 0:0:0 {{(pid=118344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 20:13:55.814561 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.virt.hardware [None req-09e741d8-d867-48a9-affc-9503098bb71b tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Flavor pref 0:0:0 {{(pid=118344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 20:13:55.814561 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.virt.hardware [None req-09e741d8-d867-48a9-affc-9503098bb71b tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Image pref 0:0:0 {{(pid=118344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 20:13:55.814561 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.virt.hardware [None req-09e741d8-d867-48a9-affc-9503098bb71b tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 20:13:55.818179 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-ddcd4b4e-d136-4087-b0a7-54c44c22ab68 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:13:55.818297 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-09e741d8-d867-48a9-affc-9503098bb71b tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:13:55.818297 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-09e741d8-d867-48a9-affc-9503098bb71b tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:13:55.818297 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-09e741d8-d867-48a9-affc-9503098bb71b tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:13:55.818297 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-09e741d8-d867-48a9-affc-9503098bb71b tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:13:55.818583 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-ddcd4b4e-d136-4087-b0a7-54c44c22ab68 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:13:55.818583 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-ddcd4b4e-d136-4087-b0a7-54c44c22ab68 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:13:55.818583 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-ddcd4b4e-d136-4087-b0a7-54c44c22ab68 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a" status: 200 len: 1745 microversion: 2.20 time: 0.155064 Jul 21 20:13:55.818817 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 423/824] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:13:55 2022] GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 20:13:55.826696 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.quota [None req-09e741d8-d867-48a9-affc-9503098bb71b tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Getting quotas for project e0075f5ba84547c782504d23f6029fd2. Resources: {'instances', 'cores', 'ram'} {{(pid=118344) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 20:13:55.831280 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.quota [None req-09e741d8-d867-48a9-affc-9503098bb71b tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Getting quotas for user d04a0e68aea7424181f6c2728cbf7e3f and project e0075f5ba84547c782504d23f6029fd2. Resources: {'instances', 'cores', 'ram'} {{(pid=118344) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 20:13:55.842083 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-09e741d8-d867-48a9-affc-9503098bb71b tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Going to run 1 instances... {{(pid=118344) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 20:13:55.844440 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-09e741d8-d867-48a9-affc-9503098bb71b tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 392749b4-22f6-470d-9b2e-4a9b2ded152b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='357a1479-6cbd-4882-8d3f-d945fa40e6df',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118344) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 20:13:55.960864 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-09e741d8-d867-48a9-affc-9503098bb71b tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.640611 Jul 21 20:13:55.961432 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 402/825] 10.222.0.58 () {60 vars in 1146 bytes} [Thu Jul 21 20:13:55 2022] POST /compute/v2.1/servers => generated 402 bytes in 642 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 20:13:55.972092 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-b4c956e5-df45-406d-b49e-87f339f1d0ef tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:13:55.972704 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-b4c956e5-df45-406d-b49e-87f339f1d0ef tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 392749b4-22f6-470d-9b2e-4a9b2ded152b] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:13:56.026912 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-b4c956e5-df45-406d-b49e-87f339f1d0ef tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:13:56.033904 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-b4c956e5-df45-406d-b49e-87f339f1d0ef tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/392749b4-22f6-470d-9b2e-4a9b2ded152b" status: 200 len: 1242 microversion: 2.1 time: 0.066246 Jul 21 20:13:56.034461 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 424/826] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:13:55 2022] GET /compute/v2.1/servers/392749b4-22f6-470d-9b2e-4a9b2ded152b => generated 1242 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:13:56.832872 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-0e19b609-272f-4bc4-834b-4a2ab0cf298e tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:13:56.833478 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-0e19b609-272f-4bc4-834b-4a2ab0cf298e tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: 5610f3fc-4e8b-48c0-a628-4b5c9419635a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:13:56.840269 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-0e19b609-272f-4bc4-834b-4a2ab0cf298e tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:13:56.840717 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-0e19b609-272f-4bc4-834b-4a2ab0cf298e tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:13:56.841513 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-0e19b609-272f-4bc4-834b-4a2ab0cf298e tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:13:56.841945 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-0e19b609-272f-4bc4-834b-4a2ab0cf298e tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:13:56.979569 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-0e19b609-272f-4bc4-834b-4a2ab0cf298e tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:13:56.987521 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-0e19b609-272f-4bc4-834b-4a2ab0cf298e tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:13:56.991528 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-0e19b609-272f-4bc4-834b-4a2ab0cf298e tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:13:56.991528 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-0e19b609-272f-4bc4-834b-4a2ab0cf298e tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a" status: 200 len: 1745 microversion: 2.20 time: 0.161858 Jul 21 20:13:56.991528 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 403/827] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:13:56 2022] GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a => generated 1745 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:13:57.050891 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-a3ad067f-6efa-4fa0-b4d6-b923e7b2d02d tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:13:57.051471 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-a3ad067f-6efa-4fa0-b4d6-b923e7b2d02d tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 392749b4-22f6-470d-9b2e-4a9b2ded152b] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:13:57.057432 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a3ad067f-6efa-4fa0-b4d6-b923e7b2d02d tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:13:57.057875 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a3ad067f-6efa-4fa0-b4d6-b923e7b2d02d tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:13:57.058635 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a3ad067f-6efa-4fa0-b4d6-b923e7b2d02d tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:13:57.059150 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a3ad067f-6efa-4fa0-b4d6-b923e7b2d02d tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:13:57.123417 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-a3ad067f-6efa-4fa0-b4d6-b923e7b2d02d tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:13:57.130889 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-a3ad067f-6efa-4fa0-b4d6-b923e7b2d02d tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/392749b4-22f6-470d-9b2e-4a9b2ded152b" status: 200 len: 1246 microversion: 2.1 time: 0.084058 Jul 21 20:13:57.131482 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 425/828] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:13:57 2022] GET /compute/v2.1/servers/392749b4-22f6-470d-9b2e-4a9b2ded152b => generated 1246 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:13:58.008692 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-cf3c88f3-fd8d-4b38-bfc4-e3099c0ffb50 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:13:58.010016 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-cf3c88f3-fd8d-4b38-bfc4-e3099c0ffb50 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: 5610f3fc-4e8b-48c0-a628-4b5c9419635a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:13:58.017473 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-cf3c88f3-fd8d-4b38-bfc4-e3099c0ffb50 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:13:58.017918 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-cf3c88f3-fd8d-4b38-bfc4-e3099c0ffb50 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:13:58.018689 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-cf3c88f3-fd8d-4b38-bfc4-e3099c0ffb50 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:13:58.030388 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-cf3c88f3-fd8d-4b38-bfc4-e3099c0ffb50 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:13:58.149158 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-8fc0fe1a-f216-43d6-8c06-e441b8b9dc77 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:13:58.150436 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-8fc0fe1a-f216-43d6-8c06-e441b8b9dc77 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 392749b4-22f6-470d-9b2e-4a9b2ded152b] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:13:58.157387 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8fc0fe1a-f216-43d6-8c06-e441b8b9dc77 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:13:58.158190 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8fc0fe1a-f216-43d6-8c06-e441b8b9dc77 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:13:58.159387 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8fc0fe1a-f216-43d6-8c06-e441b8b9dc77 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:13:58.159986 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8fc0fe1a-f216-43d6-8c06-e441b8b9dc77 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:13:58.181877 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-cf3c88f3-fd8d-4b38-bfc4-e3099c0ffb50 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:13:58.190348 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-cf3c88f3-fd8d-4b38-bfc4-e3099c0ffb50 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:13:58.192078 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-cf3c88f3-fd8d-4b38-bfc4-e3099c0ffb50 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:13:58.193609 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-cf3c88f3-fd8d-4b38-bfc4-e3099c0ffb50 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a" status: 200 len: 1740 microversion: 2.20 time: 0.189187 Jul 21 20:13:58.195710 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 404/829] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:13:58 2022] GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a => generated 1740 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:13:58.237456 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-8fc0fe1a-f216-43d6-8c06-e441b8b9dc77 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:13:58.248017 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-8fc0fe1a-f216-43d6-8c06-e441b8b9dc77 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/392749b4-22f6-470d-9b2e-4a9b2ded152b" status: 200 len: 1294 microversion: 2.1 time: 0.103906 Jul 21 20:13:58.251357 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 426/830] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:13:58 2022] GET /compute/v2.1/servers/392749b4-22f6-470d-9b2e-4a9b2ded152b => generated 1294 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:13:59.213454 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-54920b0c-4219-408f-ac17-2d90c24e7772 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:13:59.214255 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-54920b0c-4219-408f-ac17-2d90c24e7772 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: 5610f3fc-4e8b-48c0-a628-4b5c9419635a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:13:59.221993 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-54920b0c-4219-408f-ac17-2d90c24e7772 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:13:59.222739 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-54920b0c-4219-408f-ac17-2d90c24e7772 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:13:59.224107 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-54920b0c-4219-408f-ac17-2d90c24e7772 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:13:59.224630 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-54920b0c-4219-408f-ac17-2d90c24e7772 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:13:59.266591 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-73837655-2e14-44a1-9117-97378add39e2 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:13:59.269175 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-73837655-2e14-44a1-9117-97378add39e2 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 392749b4-22f6-470d-9b2e-4a9b2ded152b] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:13:59.278794 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-73837655-2e14-44a1-9117-97378add39e2 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:13:59.279546 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-73837655-2e14-44a1-9117-97378add39e2 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:13:59.283735 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-73837655-2e14-44a1-9117-97378add39e2 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:13:59.285099 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-73837655-2e14-44a1-9117-97378add39e2 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:13:59.372832 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-54920b0c-4219-408f-ac17-2d90c24e7772 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:13:59.375079 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-73837655-2e14-44a1-9117-97378add39e2 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:13:59.382241 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-54920b0c-4219-408f-ac17-2d90c24e7772 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:13:59.384168 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-54920b0c-4219-408f-ac17-2d90c24e7772 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:13:59.385604 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-54920b0c-4219-408f-ac17-2d90c24e7772 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a" status: 200 len: 1740 microversion: 2.20 time: 0.176574 Jul 21 20:13:59.386647 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 405/831] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:13:59 2022] GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a => generated 1740 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:13:59.390650 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-73837655-2e14-44a1-9117-97378add39e2 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/392749b4-22f6-470d-9b2e-4a9b2ded152b" status: 200 len: 1300 microversion: 2.1 time: 0.129058 Jul 21 20:13:59.397181 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 427/832] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:13:59 2022] GET /compute/v2.1/servers/392749b4-22f6-470d-9b2e-4a9b2ded152b => generated 1300 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:14:00.404961 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-d9da8224-f5b7-40ed-9327-4dcb28d7a234 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:14:00.407815 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-d9da8224-f5b7-40ed-9327-4dcb28d7a234 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: 5610f3fc-4e8b-48c0-a628-4b5c9419635a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:14:00.412505 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-c2567995-8bef-4f15-b9b3-becc22ceec48 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:14:00.413124 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-c2567995-8bef-4f15-b9b3-becc22ceec48 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 392749b4-22f6-470d-9b2e-4a9b2ded152b] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:14:00.416406 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-d9da8224-f5b7-40ed-9327-4dcb28d7a234 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:00.416924 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-d9da8224-f5b7-40ed-9327-4dcb28d7a234 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:00.417802 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-d9da8224-f5b7-40ed-9327-4dcb28d7a234 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:00.418298 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-d9da8224-f5b7-40ed-9327-4dcb28d7a234 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:00.427156 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c2567995-8bef-4f15-b9b3-becc22ceec48 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:00.427609 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c2567995-8bef-4f15-b9b3-becc22ceec48 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:00.428401 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c2567995-8bef-4f15-b9b3-becc22ceec48 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:00.428837 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c2567995-8bef-4f15-b9b3-becc22ceec48 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:00.583266 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-d9da8224-f5b7-40ed-9327-4dcb28d7a234 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:00.595234 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-d9da8224-f5b7-40ed-9327-4dcb28d7a234 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:00.597325 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-d9da8224-f5b7-40ed-9327-4dcb28d7a234 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:00.599364 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-d9da8224-f5b7-40ed-9327-4dcb28d7a234 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a" status: 200 len: 1740 microversion: 2.20 time: 0.198359 Jul 21 20:14:00.600575 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 406/833] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:14:00 2022] GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a => generated 1740 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:14:00.607983 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-c2567995-8bef-4f15-b9b3-becc22ceec48 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:00.616657 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-c2567995-8bef-4f15-b9b3-becc22ceec48 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/392749b4-22f6-470d-9b2e-4a9b2ded152b" status: 200 len: 1368 microversion: 2.1 time: 0.208109 Jul 21 20:14:00.617389 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 428/834] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:14:00 2022] GET /compute/v2.1/servers/392749b4-22f6-470d-9b2e-4a9b2ded152b => generated 1368 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:14:01.619596 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-11e6ea1d-c154-4fd8-a14b-916f3e0a4df3 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:14:01.620263 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-11e6ea1d-c154-4fd8-a14b-916f3e0a4df3 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: 5610f3fc-4e8b-48c0-a628-4b5c9419635a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:14:01.626889 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-11e6ea1d-c154-4fd8-a14b-916f3e0a4df3 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:01.628074 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-11e6ea1d-c154-4fd8-a14b-916f3e0a4df3 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:01.628988 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-11e6ea1d-c154-4fd8-a14b-916f3e0a4df3 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:01.629435 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-11e6ea1d-c154-4fd8-a14b-916f3e0a4df3 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:01.633665 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-77ccc8d7-c117-4d07-a5f3-bf95c4b4a87a tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:14:01.634276 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-77ccc8d7-c117-4d07-a5f3-bf95c4b4a87a tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 392749b4-22f6-470d-9b2e-4a9b2ded152b] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:14:01.640249 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-77ccc8d7-c117-4d07-a5f3-bf95c4b4a87a tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:01.640696 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-77ccc8d7-c117-4d07-a5f3-bf95c4b4a87a tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:01.641981 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-77ccc8d7-c117-4d07-a5f3-bf95c4b4a87a tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:01.642412 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-77ccc8d7-c117-4d07-a5f3-bf95c4b4a87a tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:01.766932 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-11e6ea1d-c154-4fd8-a14b-916f3e0a4df3 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:01.782733 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-11e6ea1d-c154-4fd8-a14b-916f3e0a4df3 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:01.784318 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-11e6ea1d-c154-4fd8-a14b-916f3e0a4df3 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:01.785486 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-11e6ea1d-c154-4fd8-a14b-916f3e0a4df3 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a" status: 200 len: 1740 microversion: 2.20 time: 0.170756 Jul 21 20:14:01.786048 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 407/835] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:14:01 2022] GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a => generated 1740 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:14:01.797733 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-77ccc8d7-c117-4d07-a5f3-bf95c4b4a87a tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:01.805056 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-77ccc8d7-c117-4d07-a5f3-bf95c4b4a87a tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/392749b4-22f6-470d-9b2e-4a9b2ded152b" status: 200 len: 1368 microversion: 2.1 time: 0.175217 Jul 21 20:14:01.805634 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 429/836] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:14:01 2022] GET /compute/v2.1/servers/392749b4-22f6-470d-9b2e-4a9b2ded152b => generated 1368 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:14:02.711271 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [req-72257ab7-ab8a-47b7-9771-07df1a7e224f req-670dcf54-f9f3-4aa3-96a4-28db30dfc3b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "392749b4-22f6-470d-9b2e-4a9b2ded152b", "tag": "a0a4f662-60e3-4ba4-829f-a5e0a18505d8"}]} {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:14:02.729423 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [req-72257ab7-ab8a-47b7-9771-07df1a7e224f req-670dcf54-f9f3-4aa3-96a4-28db30dfc3b8 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:02.729874 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [req-72257ab7-ab8a-47b7-9771-07df1a7e224f req-670dcf54-f9f3-4aa3-96a4-28db30dfc3b8 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:02.746937 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.compute.server_external_events [req-72257ab7-ab8a-47b7-9771-07df1a7e224f req-670dcf54-f9f3-4aa3-96a4-28db30dfc3b8 service nova] Creating event network-changed:a0a4f662-60e3-4ba4-829f-a5e0a18505d8 for instance 392749b4-22f6-470d-9b2e-4a9b2ded152b on hv-cinder-85054 Jul 21 20:14:02.753408 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [req-72257ab7-ab8a-47b7-9771-07df1a7e224f req-670dcf54-f9f3-4aa3-96a4-28db30dfc3b8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052166 Jul 21 20:14:02.754973 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 408/837] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 20:14:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:14:02.804152 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-325ff434-12f6-4a5e-aa25-6aa1701e9fb1 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:14:02.805427 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-325ff434-12f6-4a5e-aa25-6aa1701e9fb1 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: 5610f3fc-4e8b-48c0-a628-4b5c9419635a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:14:02.812155 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-325ff434-12f6-4a5e-aa25-6aa1701e9fb1 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:02.813448 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-325ff434-12f6-4a5e-aa25-6aa1701e9fb1 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:02.814455 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-325ff434-12f6-4a5e-aa25-6aa1701e9fb1 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:02.815080 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-325ff434-12f6-4a5e-aa25-6aa1701e9fb1 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:02.829076 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-0fdecd14-0a88-4c25-b4d3-e6799cce7d75 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:14:02.829898 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-0fdecd14-0a88-4c25-b4d3-e6799cce7d75 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 392749b4-22f6-470d-9b2e-4a9b2ded152b] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:14:02.838227 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-0fdecd14-0a88-4c25-b4d3-e6799cce7d75 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:02.839288 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-0fdecd14-0a88-4c25-b4d3-e6799cce7d75 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:02.840299 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-0fdecd14-0a88-4c25-b4d3-e6799cce7d75 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:02.840939 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-0fdecd14-0a88-4c25-b4d3-e6799cce7d75 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:03.018380 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-325ff434-12f6-4a5e-aa25-6aa1701e9fb1 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:03.027515 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-325ff434-12f6-4a5e-aa25-6aa1701e9fb1 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:03.029445 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-325ff434-12f6-4a5e-aa25-6aa1701e9fb1 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:03.032207 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-325ff434-12f6-4a5e-aa25-6aa1701e9fb1 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a" status: 200 len: 1740 microversion: 2.20 time: 0.231915 Jul 21 20:14:03.033456 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 430/838] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:14:02 2022] GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a => generated 1740 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:14:03.036996 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-0fdecd14-0a88-4c25-b4d3-e6799cce7d75 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:03.046081 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-0fdecd14-0a88-4c25-b4d3-e6799cce7d75 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/392749b4-22f6-470d-9b2e-4a9b2ded152b" status: 200 len: 1368 microversion: 2.1 time: 0.222476 Jul 21 20:14:03.046947 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 409/839] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:14:02 2022] GET /compute/v2.1/servers/392749b4-22f6-470d-9b2e-4a9b2ded152b => generated 1368 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:14:04.052266 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-d6d8b369-fe1f-4a6c-a0dc-1c2bd388b211 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:14:04.053491 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-d6d8b369-fe1f-4a6c-a0dc-1c2bd388b211 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: 5610f3fc-4e8b-48c0-a628-4b5c9419635a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:14:04.064048 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-ad3a2033-10ed-45c9-af85-9442ef8cc3d2 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:14:04.070798 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-ad3a2033-10ed-45c9-af85-9442ef8cc3d2 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 392749b4-22f6-470d-9b2e-4a9b2ded152b] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:14:04.070798 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG dbcounter [-] [118344] Writing DB stats nova_api:SELECT=67,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:14:04.071875 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d6d8b369-fe1f-4a6c-a0dc-1c2bd388b211 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:04.072333 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d6d8b369-fe1f-4a6c-a0dc-1c2bd388b211 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:04.074034 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d6d8b369-fe1f-4a6c-a0dc-1c2bd388b211 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:04.074502 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-ad3a2033-10ed-45c9-af85-9442ef8cc3d2 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:04.074648 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d6d8b369-fe1f-4a6c-a0dc-1c2bd388b211 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:04.078208 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-ad3a2033-10ed-45c9-af85-9442ef8cc3d2 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:04.081516 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-ad3a2033-10ed-45c9-af85-9442ef8cc3d2 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:04.081996 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-ad3a2033-10ed-45c9-af85-9442ef8cc3d2 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:04.245242 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-ad3a2033-10ed-45c9-af85-9442ef8cc3d2 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:04.253954 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-ad3a2033-10ed-45c9-af85-9442ef8cc3d2 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/392749b4-22f6-470d-9b2e-4a9b2ded152b" status: 200 len: 1368 microversion: 2.1 time: 0.194215 Jul 21 20:14:04.263154 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 410/840] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:14:04 2022] GET /compute/v2.1/servers/392749b4-22f6-470d-9b2e-4a9b2ded152b => generated 1368 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:14:04.285763 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-d6d8b369-fe1f-4a6c-a0dc-1c2bd388b211 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:04.294610 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-d6d8b369-fe1f-4a6c-a0dc-1c2bd388b211 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:04.296615 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-d6d8b369-fe1f-4a6c-a0dc-1c2bd388b211 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:04.298457 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-d6d8b369-fe1f-4a6c-a0dc-1c2bd388b211 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a" status: 200 len: 1740 microversion: 2.20 time: 0.251041 Jul 21 20:14:04.299247 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 431/841] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:14:04 2022] GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a => generated 1740 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:14:05.270639 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-d3a440c0-9a3d-4711-9323-f34f5ca27da1 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:14:05.271269 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-d3a440c0-9a3d-4711-9323-f34f5ca27da1 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 392749b4-22f6-470d-9b2e-4a9b2ded152b] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:14:05.278394 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-d3a440c0-9a3d-4711-9323-f34f5ca27da1 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:05.278836 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-d3a440c0-9a3d-4711-9323-f34f5ca27da1 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:05.279608 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-d3a440c0-9a3d-4711-9323-f34f5ca27da1 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:05.280037 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-d3a440c0-9a3d-4711-9323-f34f5ca27da1 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:05.326220 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-5b6b687b-cfe7-4ab2-9afd-3ac2bb1c37ca tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:14:05.326798 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-5b6b687b-cfe7-4ab2-9afd-3ac2bb1c37ca tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: 5610f3fc-4e8b-48c0-a628-4b5c9419635a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:14:05.328639 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:14:05.333512 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5b6b687b-cfe7-4ab2-9afd-3ac2bb1c37ca tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:05.334005 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5b6b687b-cfe7-4ab2-9afd-3ac2bb1c37ca tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:05.334800 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5b6b687b-cfe7-4ab2-9afd-3ac2bb1c37ca tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:05.335281 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5b6b687b-cfe7-4ab2-9afd-3ac2bb1c37ca tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:05.425676 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-d3a440c0-9a3d-4711-9323-f34f5ca27da1 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:05.433679 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-d3a440c0-9a3d-4711-9323-f34f5ca27da1 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/392749b4-22f6-470d-9b2e-4a9b2ded152b" status: 200 len: 1368 microversion: 2.1 time: 0.166985 Jul 21 20:14:05.434359 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 411/842] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:14:05 2022] GET /compute/v2.1/servers/392749b4-22f6-470d-9b2e-4a9b2ded152b => generated 1368 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:14:05.485336 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-5b6b687b-cfe7-4ab2-9afd-3ac2bb1c37ca tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:05.485336 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-5b6b687b-cfe7-4ab2-9afd-3ac2bb1c37ca tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:05.485662 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-5b6b687b-cfe7-4ab2-9afd-3ac2bb1c37ca tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:05.485662 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-5b6b687b-cfe7-4ab2-9afd-3ac2bb1c37ca tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a" status: 200 len: 1740 microversion: 2.20 time: 0.162253 Jul 21 20:14:05.485662 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 432/843] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:14:05 2022] GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a => generated 1740 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:14:06.451632 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-c158640b-240e-4c5b-8fe8-10f152008b21 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:14:06.452853 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-c158640b-240e-4c5b-8fe8-10f152008b21 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 392749b4-22f6-470d-9b2e-4a9b2ded152b] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:14:06.459515 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG dbcounter [-] [118344] Writing DB stats nova_cell0:SELECT=2 {{(pid=118344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:14:06.460609 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG dbcounter [-] [118344] Writing DB stats nova_cell0:SELECT=6 {{(pid=118344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:14:06.462822 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-c158640b-240e-4c5b-8fe8-10f152008b21 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:06.463927 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-c158640b-240e-4c5b-8fe8-10f152008b21 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:06.464129 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-c158640b-240e-4c5b-8fe8-10f152008b21 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:06.464733 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-c158640b-240e-4c5b-8fe8-10f152008b21 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:06.504021 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-08b58afa-e68f-4b9c-b308-713d68a2edde tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:14:06.505997 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-08b58afa-e68f-4b9c-b308-713d68a2edde tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: 5610f3fc-4e8b-48c0-a628-4b5c9419635a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:14:06.519183 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell0:SELECT=6 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:14:06.523129 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-08b58afa-e68f-4b9c-b308-713d68a2edde tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:06.524367 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-08b58afa-e68f-4b9c-b308-713d68a2edde tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:06.526974 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-08b58afa-e68f-4b9c-b308-713d68a2edde tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:06.528089 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-08b58afa-e68f-4b9c-b308-713d68a2edde tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:06.636863 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-c158640b-240e-4c5b-8fe8-10f152008b21 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:06.653741 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-c158640b-240e-4c5b-8fe8-10f152008b21 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/392749b4-22f6-470d-9b2e-4a9b2ded152b" status: 200 len: 1368 microversion: 2.1 time: 0.206038 Jul 21 20:14:06.667633 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 412/844] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:14:06 2022] GET /compute/v2.1/servers/392749b4-22f6-470d-9b2e-4a9b2ded152b => generated 1368 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:14:07.047320 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-08b58afa-e68f-4b9c-b308-713d68a2edde tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:07.057782 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-08b58afa-e68f-4b9c-b308-713d68a2edde tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:07.059778 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-08b58afa-e68f-4b9c-b308-713d68a2edde tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:07.061153 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-08b58afa-e68f-4b9c-b308-713d68a2edde tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a" status: 200 len: 1740 microversion: 2.20 time: 0.562953 Jul 21 20:14:07.062574 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 433/845] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:14:06 2022] GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a => generated 1740 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 20:14:07.672442 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-18d1eb23-d2cd-4b30-9289-50ea0e432579 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:14:07.674221 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-18d1eb23-d2cd-4b30-9289-50ea0e432579 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 392749b4-22f6-470d-9b2e-4a9b2ded152b] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:14:07.682705 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-18d1eb23-d2cd-4b30-9289-50ea0e432579 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:07.683890 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-18d1eb23-d2cd-4b30-9289-50ea0e432579 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:07.684999 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-18d1eb23-d2cd-4b30-9289-50ea0e432579 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:07.685638 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-18d1eb23-d2cd-4b30-9289-50ea0e432579 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:07.764509 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-4a387060-d0eb-4c2f-a8dc-d3ac3efc31fa tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:14:07.765929 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-4a387060-d0eb-4c2f-a8dc-d3ac3efc31fa tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] [instance: 301ed3ad-5cb4-4ebf-ac32-519ab482cdea] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:14:07.774144 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4a387060-d0eb-4c2f-a8dc-d3ac3efc31fa tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:07.779845 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4a387060-d0eb-4c2f-a8dc-d3ac3efc31fa tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:07.780890 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4a387060-d0eb-4c2f-a8dc-d3ac3efc31fa tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:07.781521 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4a387060-d0eb-4c2f-a8dc-d3ac3efc31fa tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:07.824529 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-4a387060-d0eb-4c2f-a8dc-d3ac3efc31fa tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] [instance: 301ed3ad-5cb4-4ebf-ac32-519ab482cdea] Going to try to terminate instance {{(pid=118345) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 20:14:07.913776 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-18d1eb23-d2cd-4b30-9289-50ea0e432579 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:07.929523 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-18d1eb23-d2cd-4b30-9289-50ea0e432579 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/392749b4-22f6-470d-9b2e-4a9b2ded152b" status: 200 len: 1368 microversion: 2.1 time: 0.261178 Jul 21 20:14:07.930443 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 413/846] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:14:07 2022] GET /compute/v2.1/servers/392749b4-22f6-470d-9b2e-4a9b2ded152b => generated 1368 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:14:07.936503 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [req-e34baf90-e586-4a08-9374-d2fab52cfc62 req-86c0b622-9b06-4cc0-ab0a-03ee4e063540 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "301ed3ad-5cb4-4ebf-ac32-519ab482cdea", "tag": "4300c7df-3693-4c3f-ae64-d9d267e9d57d"}]} {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:14:07.948041 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [req-e34baf90-e586-4a08-9374-d2fab52cfc62 req-86c0b622-9b06-4cc0-ab0a-03ee4e063540 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:07.948638 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [req-e34baf90-e586-4a08-9374-d2fab52cfc62 req-86c0b622-9b06-4cc0-ab0a-03ee4e063540 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:07.964763 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.compute.server_external_events [req-e34baf90-e586-4a08-9374-d2fab52cfc62 req-86c0b622-9b06-4cc0-ab0a-03ee4e063540 service nova] Creating event network-changed:4300c7df-3693-4c3f-ae64-d9d267e9d57d for instance 301ed3ad-5cb4-4ebf-ac32-519ab482cdea on hv-cinder-85054 Jul 21 20:14:07.972290 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [req-e34baf90-e586-4a08-9374-d2fab52cfc62 req-86c0b622-9b06-4cc0-ab0a-03ee4e063540 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040153 Jul 21 20:14:07.984623 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 414/847] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 20:14:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:14:07.999199 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:14:08.081706 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-4e224da5-e8c3-47c5-9f98-84b35efa2afa tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:14:08.082753 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-4e224da5-e8c3-47c5-9f98-84b35efa2afa tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: 5610f3fc-4e8b-48c0-a628-4b5c9419635a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:14:08.105144 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-4e224da5-e8c3-47c5-9f98-84b35efa2afa tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:08.107743 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-4e224da5-e8c3-47c5-9f98-84b35efa2afa tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:08.108974 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-4e224da5-e8c3-47c5-9f98-84b35efa2afa tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:08.111047 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-4e224da5-e8c3-47c5-9f98-84b35efa2afa tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:08.222397 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-4a387060-d0eb-4c2f-a8dc-d3ac3efc31fa tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] 10.222.0.58 "DELETE /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea" status: 204 len: 0 microversion: 2.1 time: 0.462406 Jul 21 20:14:08.223393 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 434/848] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Jul 21 20:14:07 2022] DELETE /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea => generated 0 bytes in 465 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 20:14:08.243725 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-5a4bbae7-526d-42b3-8b7e-298671b23c68 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:14:08.244701 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-5a4bbae7-526d-42b3-8b7e-298671b23c68 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] [instance: 301ed3ad-5cb4-4ebf-ac32-519ab482cdea] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:14:08.252913 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5a4bbae7-526d-42b3-8b7e-298671b23c68 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:08.253665 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5a4bbae7-526d-42b3-8b7e-298671b23c68 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:08.254712 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5a4bbae7-526d-42b3-8b7e-298671b23c68 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:08.255378 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5a4bbae7-526d-42b3-8b7e-298671b23c68 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:08.297266 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-4e224da5-e8c3-47c5-9f98-84b35efa2afa tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:08.309311 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-4e224da5-e8c3-47c5-9f98-84b35efa2afa tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:08.311332 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-4e224da5-e8c3-47c5-9f98-84b35efa2afa tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:08.314987 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-4e224da5-e8c3-47c5-9f98-84b35efa2afa tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a" status: 200 len: 1740 microversion: 2.20 time: 0.237342 Jul 21 20:14:08.316334 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 415/849] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:14:08 2022] GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a => generated 1740 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 20:14:08.437129 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-5a4bbae7-526d-42b3-8b7e-298671b23c68 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf78e0fe86d4e078c0527248af45cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4239f4ae39bb49cf8063377a93875456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:08.446931 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-5a4bbae7-526d-42b3-8b7e-298671b23c68 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] 10.222.0.58 "GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea" status: 200 len: 1568 microversion: 2.1 time: 0.207872 Jul 21 20:14:08.450584 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 435/850] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:14:08 2022] GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea => generated 1568 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:14:08.947341 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-5fe4e852-7c03-4e0b-94c3-37c770ae7fc2 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:14:08.947947 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-5fe4e852-7c03-4e0b-94c3-37c770ae7fc2 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 392749b4-22f6-470d-9b2e-4a9b2ded152b] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:14:08.955212 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-5fe4e852-7c03-4e0b-94c3-37c770ae7fc2 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:08.955658 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-5fe4e852-7c03-4e0b-94c3-37c770ae7fc2 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:08.956516 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-5fe4e852-7c03-4e0b-94c3-37c770ae7fc2 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:08.956973 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-5fe4e852-7c03-4e0b-94c3-37c770ae7fc2 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:09.090609 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-5fe4e852-7c03-4e0b-94c3-37c770ae7fc2 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:09.098475 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-5fe4e852-7c03-4e0b-94c3-37c770ae7fc2 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/392749b4-22f6-470d-9b2e-4a9b2ded152b" status: 200 len: 1368 microversion: 2.1 time: 0.155147 Jul 21 20:14:09.099119 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 416/851] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:14:08 2022] GET /compute/v2.1/servers/392749b4-22f6-470d-9b2e-4a9b2ded152b => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:14:09.333373 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-73fc5d00-c888-4a7b-ab0a-836caca0e8b8 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:14:09.334070 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-73fc5d00-c888-4a7b-ab0a-836caca0e8b8 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: 5610f3fc-4e8b-48c0-a628-4b5c9419635a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:14:09.340934 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-73fc5d00-c888-4a7b-ab0a-836caca0e8b8 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:09.341379 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-73fc5d00-c888-4a7b-ab0a-836caca0e8b8 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:09.342149 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-73fc5d00-c888-4a7b-ab0a-836caca0e8b8 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:09.342597 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-73fc5d00-c888-4a7b-ab0a-836caca0e8b8 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:09.468084 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-ecf64b46-df40-4d42-85bb-41f04ec25fcc tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:14:09.468906 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-ecf64b46-df40-4d42-85bb-41f04ec25fcc tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] [instance: 301ed3ad-5cb4-4ebf-ac32-519ab482cdea] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:14:09.477938 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-ecf64b46-df40-4d42-85bb-41f04ec25fcc tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:09.478602 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-ecf64b46-df40-4d42-85bb-41f04ec25fcc tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:09.479599 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-ecf64b46-df40-4d42-85bb-41f04ec25fcc tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:09.480212 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-ecf64b46-df40-4d42-85bb-41f04ec25fcc tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:09.489565 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-73fc5d00-c888-4a7b-ab0a-836caca0e8b8 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:09.510231 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-73fc5d00-c888-4a7b-ab0a-836caca0e8b8 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:09.511881 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-73fc5d00-c888-4a7b-ab0a-836caca0e8b8 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:09.513062 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-73fc5d00-c888-4a7b-ab0a-836caca0e8b8 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a" status: 200 len: 1740 microversion: 2.20 time: 0.183671 Jul 21 20:14:09.524187 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 436/852] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:14:09 2022] GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a => generated 1740 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:14:09.655590 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-ecf64b46-df40-4d42-85bb-41f04ec25fcc tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf78e0fe86d4e078c0527248af45cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4239f4ae39bb49cf8063377a93875456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:09.664207 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-ecf64b46-df40-4d42-85bb-41f04ec25fcc tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] 10.222.0.58 "GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea" status: 200 len: 1568 microversion: 2.1 time: 0.199939 Jul 21 20:14:09.665044 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 417/853] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:14:09 2022] GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea => generated 1568 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:14:10.115541 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-9b726912-332e-4018-88d8-7134515536d3 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:14:10.116294 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-9b726912-332e-4018-88d8-7134515536d3 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 392749b4-22f6-470d-9b2e-4a9b2ded152b] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:14:10.122934 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-9b726912-332e-4018-88d8-7134515536d3 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:10.123504 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-9b726912-332e-4018-88d8-7134515536d3 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:10.124362 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-9b726912-332e-4018-88d8-7134515536d3 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:10.124870 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-9b726912-332e-4018-88d8-7134515536d3 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:10.263662 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-9b726912-332e-4018-88d8-7134515536d3 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:10.271342 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-9b726912-332e-4018-88d8-7134515536d3 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/392749b4-22f6-470d-9b2e-4a9b2ded152b" status: 200 len: 1368 microversion: 2.1 time: 0.159858 Jul 21 20:14:10.271940 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 437/854] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:14:10 2022] GET /compute/v2.1/servers/392749b4-22f6-470d-9b2e-4a9b2ded152b => generated 1368 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:14:10.531605 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-e1326787-e541-494e-8d46-8701f2bf5e5e tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:14:10.532897 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-e1326787-e541-494e-8d46-8701f2bf5e5e tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: 5610f3fc-4e8b-48c0-a628-4b5c9419635a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:14:10.539480 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-e1326787-e541-494e-8d46-8701f2bf5e5e tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:10.539922 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-e1326787-e541-494e-8d46-8701f2bf5e5e tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:10.540773 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-e1326787-e541-494e-8d46-8701f2bf5e5e tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:10.541209 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-e1326787-e541-494e-8d46-8701f2bf5e5e tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:10.674191 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-e1326787-e541-494e-8d46-8701f2bf5e5e tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:10.682176 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-f52a515b-2287-4617-a557-c0146864a689 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:14:10.686572 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-e1326787-e541-494e-8d46-8701f2bf5e5e tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:10.686780 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-f52a515b-2287-4617-a557-c0146864a689 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] [instance: 301ed3ad-5cb4-4ebf-ac32-519ab482cdea] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:14:10.686896 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-e1326787-e541-494e-8d46-8701f2bf5e5e tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:10.686896 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-e1326787-e541-494e-8d46-8701f2bf5e5e tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a" status: 200 len: 1740 microversion: 2.20 time: 0.157589 Jul 21 20:14:10.686896 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 418/855] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:14:10 2022] GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a => generated 1740 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:14:10.689348 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f52a515b-2287-4617-a557-c0146864a689 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:10.689798 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f52a515b-2287-4617-a557-c0146864a689 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:10.690585 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f52a515b-2287-4617-a557-c0146864a689 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:10.691000 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f52a515b-2287-4617-a557-c0146864a689 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:10.819989 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-f52a515b-2287-4617-a557-c0146864a689 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf78e0fe86d4e078c0527248af45cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4239f4ae39bb49cf8063377a93875456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:10.827440 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-f52a515b-2287-4617-a557-c0146864a689 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] 10.222.0.58 "GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea" status: 200 len: 1568 microversion: 2.1 time: 0.149074 Jul 21 20:14:10.828003 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 438/856] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:14:10 2022] GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:14:11.288629 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-520d4340-4224-499d-a1e1-888cebadc951 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:14:11.289239 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-520d4340-4224-499d-a1e1-888cebadc951 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 392749b4-22f6-470d-9b2e-4a9b2ded152b] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:14:11.295386 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-520d4340-4224-499d-a1e1-888cebadc951 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:11.295834 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-520d4340-4224-499d-a1e1-888cebadc951 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:11.296592 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-520d4340-4224-499d-a1e1-888cebadc951 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:11.297025 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-520d4340-4224-499d-a1e1-888cebadc951 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:11.437876 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-520d4340-4224-499d-a1e1-888cebadc951 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:11.437876 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-520d4340-4224-499d-a1e1-888cebadc951 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/392749b4-22f6-470d-9b2e-4a9b2ded152b" status: 200 len: 1368 microversion: 2.1 time: 0.147810 Jul 21 20:14:11.437876 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 419/857] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:14:11 2022] GET /compute/v2.1/servers/392749b4-22f6-470d-9b2e-4a9b2ded152b => generated 1368 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:14:11.703245 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-1a767454-3cde-4488-8d68-481a3f7913b2 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:14:11.703890 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-1a767454-3cde-4488-8d68-481a3f7913b2 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: 5610f3fc-4e8b-48c0-a628-4b5c9419635a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:14:11.709798 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1a767454-3cde-4488-8d68-481a3f7913b2 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:11.710273 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1a767454-3cde-4488-8d68-481a3f7913b2 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:11.711047 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1a767454-3cde-4488-8d68-481a3f7913b2 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:11.711498 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1a767454-3cde-4488-8d68-481a3f7913b2 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:11.845524 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-590964d6-a1f1-49c0-a643-5f91a658256b tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:14:11.846032 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-590964d6-a1f1-49c0-a643-5f91a658256b tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] [instance: 301ed3ad-5cb4-4ebf-ac32-519ab482cdea] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:14:11.852726 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-590964d6-a1f1-49c0-a643-5f91a658256b tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:11.853169 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-590964d6-a1f1-49c0-a643-5f91a658256b tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:11.853935 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-590964d6-a1f1-49c0-a643-5f91a658256b tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:11.854367 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-590964d6-a1f1-49c0-a643-5f91a658256b tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:11.873022 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG dbcounter [-] [118344] Writing DB stats nova_cell1:SELECT=100 {{(pid=118344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:14:11.914460 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-1a767454-3cde-4488-8d68-481a3f7913b2 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:11.922405 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-1a767454-3cde-4488-8d68-481a3f7913b2 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:11.923938 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-1a767454-3cde-4488-8d68-481a3f7913b2 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:11.925083 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-1a767454-3cde-4488-8d68-481a3f7913b2 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a" status: 200 len: 1740 microversion: 2.20 time: 0.225745 Jul 21 20:14:11.925639 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 439/858] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:14:11 2022] GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a => generated 1740 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:14:11.991094 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-590964d6-a1f1-49c0-a643-5f91a658256b tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf78e0fe86d4e078c0527248af45cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4239f4ae39bb49cf8063377a93875456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:11.998404 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-590964d6-a1f1-49c0-a643-5f91a658256b tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] 10.222.0.58 "GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea" status: 200 len: 1568 microversion: 2.1 time: 0.157419 Jul 21 20:14:11.998960 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 420/859] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:14:11 2022] GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:14:12.449740 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-02be4ec3-030b-4123-924a-87bc0d46dc05 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:14:12.450347 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-02be4ec3-030b-4123-924a-87bc0d46dc05 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 392749b4-22f6-470d-9b2e-4a9b2ded152b] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:14:12.456945 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-02be4ec3-030b-4123-924a-87bc0d46dc05 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:12.457405 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-02be4ec3-030b-4123-924a-87bc0d46dc05 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:12.458188 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-02be4ec3-030b-4123-924a-87bc0d46dc05 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:12.458618 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-02be4ec3-030b-4123-924a-87bc0d46dc05 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:12.590275 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-02be4ec3-030b-4123-924a-87bc0d46dc05 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:12.598328 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-02be4ec3-030b-4123-924a-87bc0d46dc05 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/392749b4-22f6-470d-9b2e-4a9b2ded152b" status: 200 len: 1368 microversion: 2.1 time: 0.152555 Jul 21 20:14:12.599215 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 440/860] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:14:12 2022] GET /compute/v2.1/servers/392749b4-22f6-470d-9b2e-4a9b2ded152b => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:14:12.943759 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-f17f1457-1a69-4bbf-8af6-0b653c18a2a6 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:14:12.944350 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-f17f1457-1a69-4bbf-8af6-0b653c18a2a6 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: 5610f3fc-4e8b-48c0-a628-4b5c9419635a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:14:12.950879 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f17f1457-1a69-4bbf-8af6-0b653c18a2a6 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:12.951299 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f17f1457-1a69-4bbf-8af6-0b653c18a2a6 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:12.952048 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f17f1457-1a69-4bbf-8af6-0b653c18a2a6 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:12.952478 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f17f1457-1a69-4bbf-8af6-0b653c18a2a6 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:13.015798 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-4f8d1a52-81b3-45c2-8d17-f451cf346a4b tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:14:13.016406 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-4f8d1a52-81b3-45c2-8d17-f451cf346a4b tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] [instance: 301ed3ad-5cb4-4ebf-ac32-519ab482cdea] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:14:13.023417 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4f8d1a52-81b3-45c2-8d17-f451cf346a4b tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:13.030838 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4f8d1a52-81b3-45c2-8d17-f451cf346a4b tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:13.031758 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4f8d1a52-81b3-45c2-8d17-f451cf346a4b tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:13.032762 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4f8d1a52-81b3-45c2-8d17-f451cf346a4b tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:13.183764 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-f17f1457-1a69-4bbf-8af6-0b653c18a2a6 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:13.198787 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-f17f1457-1a69-4bbf-8af6-0b653c18a2a6 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:13.200335 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-f17f1457-1a69-4bbf-8af6-0b653c18a2a6 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:13.206063 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-f17f1457-1a69-4bbf-8af6-0b653c18a2a6 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a" status: 200 len: 1722 microversion: 2.20 time: 0.261863 Jul 21 20:14:13.215213 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 421/861] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:14:12 2022] GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a => generated 1722 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:14:13.317857 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [req-16b639a4-7dac-43a8-a5ab-d6bc115fd03c req-029ea878-33ec-4a82-b7df-25682d7c21ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "392749b4-22f6-470d-9b2e-4a9b2ded152b", "name": "network-vif-plugged", "status": "completed", "tag": "a0a4f662-60e3-4ba4-829f-a5e0a18505d8"}]} {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:14:13.326420 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [req-16b639a4-7dac-43a8-a5ab-d6bc115fd03c req-029ea878-33ec-4a82-b7df-25682d7c21ac service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:13.327097 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [req-16b639a4-7dac-43a8-a5ab-d6bc115fd03c req-029ea878-33ec-4a82-b7df-25682d7c21ac service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:13.339966 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.compute.server_external_events [req-16b639a4-7dac-43a8-a5ab-d6bc115fd03c req-029ea878-33ec-4a82-b7df-25682d7c21ac service nova] Creating event network-vif-plugged:a0a4f662-60e3-4ba4-829f-a5e0a18505d8 for instance 392749b4-22f6-470d-9b2e-4a9b2ded152b on hv-cinder-85054 Jul 21 20:14:13.345938 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [req-16b639a4-7dac-43a8-a5ab-d6bc115fd03c req-029ea878-33ec-4a82-b7df-25682d7c21ac service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031745 Jul 21 20:14:13.350236 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 422/862] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 20:14:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 20:14:13.437629 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-4f8d1a52-81b3-45c2-8d17-f451cf346a4b tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf78e0fe86d4e078c0527248af45cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4239f4ae39bb49cf8063377a93875456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:13.447180 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-4f8d1a52-81b3-45c2-8d17-f451cf346a4b tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] 10.222.0.58 "GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea" status: 200 len: 1568 microversion: 2.1 time: 0.435207 Jul 21 20:14:13.457616 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 441/863] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:14:13 2022] GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea => generated 1568 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:14:13.615713 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-793d37c8-82c9-4dbd-8e0b-9d993c5a195b tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:14:13.616707 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-793d37c8-82c9-4dbd-8e0b-9d993c5a195b tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 392749b4-22f6-470d-9b2e-4a9b2ded152b] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:14:13.624922 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-793d37c8-82c9-4dbd-8e0b-9d993c5a195b tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:13.625764 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-793d37c8-82c9-4dbd-8e0b-9d993c5a195b tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:13.626844 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-793d37c8-82c9-4dbd-8e0b-9d993c5a195b tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:13.627547 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-793d37c8-82c9-4dbd-8e0b-9d993c5a195b tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:13.796957 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-793d37c8-82c9-4dbd-8e0b-9d993c5a195b tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:13.808464 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-793d37c8-82c9-4dbd-8e0b-9d993c5a195b tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/392749b4-22f6-470d-9b2e-4a9b2ded152b" status: 200 len: 1368 microversion: 2.1 time: 0.196805 Jul 21 20:14:13.809045 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 423/864] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:14:13 2022] GET /compute/v2.1/servers/392749b4-22f6-470d-9b2e-4a9b2ded152b => generated 1368 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:14:13.837586 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [req-cb927fcd-93a7-4cf6-b9ed-5c60d2314f5d req-6d6efd49-4383-4e1c-83fa-7b23b57e1f4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "301ed3ad-5cb4-4ebf-ac32-519ab482cdea", "name": "network-vif-deleted", "tag": "4300c7df-3693-4c3f-ae64-d9d267e9d57d"}]} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:14:13.846587 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-cb927fcd-93a7-4cf6-b9ed-5c60d2314f5d req-6d6efd49-4383-4e1c-83fa-7b23b57e1f4c service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:13.847042 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-cb927fcd-93a7-4cf6-b9ed-5c60d2314f5d req-6d6efd49-4383-4e1c-83fa-7b23b57e1f4c service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:13.857832 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.compute.server_external_events [req-cb927fcd-93a7-4cf6-b9ed-5c60d2314f5d req-6d6efd49-4383-4e1c-83fa-7b23b57e1f4c service nova] Creating event network-vif-deleted:4300c7df-3693-4c3f-ae64-d9d267e9d57d for instance 301ed3ad-5cb4-4ebf-ac32-519ab482cdea on hv-cinder-85054 Jul 21 20:14:13.863211 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [req-cb927fcd-93a7-4cf6-b9ed-5c60d2314f5d req-6d6efd49-4383-4e1c-83fa-7b23b57e1f4c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029310 Jul 21 20:14:13.863776 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 442/865] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 20:14:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:14:14.220617 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-497a27b9-21a8-4be2-a7d5-fc7cc0044dba tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:14:14.221478 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-497a27b9-21a8-4be2-a7d5-fc7cc0044dba tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: 5610f3fc-4e8b-48c0-a628-4b5c9419635a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:14:14.229351 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-497a27b9-21a8-4be2-a7d5-fc7cc0044dba tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:14.229785 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-497a27b9-21a8-4be2-a7d5-fc7cc0044dba tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:14.230556 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-497a27b9-21a8-4be2-a7d5-fc7cc0044dba tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:14.230984 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-497a27b9-21a8-4be2-a7d5-fc7cc0044dba tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:14.363937 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-497a27b9-21a8-4be2-a7d5-fc7cc0044dba tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:14.372746 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-497a27b9-21a8-4be2-a7d5-fc7cc0044dba tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:14.374264 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-497a27b9-21a8-4be2-a7d5-fc7cc0044dba tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:14.375484 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-497a27b9-21a8-4be2-a7d5-fc7cc0044dba tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a" status: 200 len: 1722 microversion: 2.20 time: 0.159672 Jul 21 20:14:14.376039 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 424/866] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:14:14 2022] GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:14:14.465143 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-7b0c19c4-06cb-425f-a305-ea691439dd5c tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:14:14.465843 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-7b0c19c4-06cb-425f-a305-ea691439dd5c tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] [instance: 301ed3ad-5cb4-4ebf-ac32-519ab482cdea] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:14:14.473111 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-7b0c19c4-06cb-425f-a305-ea691439dd5c tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:14.473559 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-7b0c19c4-06cb-425f-a305-ea691439dd5c tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:14.474321 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-7b0c19c4-06cb-425f-a305-ea691439dd5c tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:14.474756 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-7b0c19c4-06cb-425f-a305-ea691439dd5c tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:14.540673 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-7b0c19c4-06cb-425f-a305-ea691439dd5c tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf78e0fe86d4e078c0527248af45cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4239f4ae39bb49cf8063377a93875456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:14.548464 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-7b0c19c4-06cb-425f-a305-ea691439dd5c tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] 10.222.0.58 "GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea" status: 200 len: 1382 microversion: 2.1 time: 0.087636 Jul 21 20:14:14.549032 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 443/867] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:14:14 2022] GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea => generated 1382 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:14:14.825434 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-29cd41b3-8617-462e-8e7b-c25055758133 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:14:14.826041 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-29cd41b3-8617-462e-8e7b-c25055758133 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 392749b4-22f6-470d-9b2e-4a9b2ded152b] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:14:14.832699 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-29cd41b3-8617-462e-8e7b-c25055758133 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:14.833141 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-29cd41b3-8617-462e-8e7b-c25055758133 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:14.833894 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-29cd41b3-8617-462e-8e7b-c25055758133 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:14.834325 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-29cd41b3-8617-462e-8e7b-c25055758133 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:14.963387 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-29cd41b3-8617-462e-8e7b-c25055758133 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:14.970628 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-29cd41b3-8617-462e-8e7b-c25055758133 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/392749b4-22f6-470d-9b2e-4a9b2ded152b" status: 200 len: 1368 microversion: 2.1 time: 0.149082 Jul 21 20:14:14.971467 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 425/868] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:14:14 2022] GET /compute/v2.1/servers/392749b4-22f6-470d-9b2e-4a9b2ded152b => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:14:15.393552 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-dab26ae5-7bdd-4682-a58d-1762f09ff0b1 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:14:15.394598 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-dab26ae5-7bdd-4682-a58d-1762f09ff0b1 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: 5610f3fc-4e8b-48c0-a628-4b5c9419635a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:14:15.400772 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-dab26ae5-7bdd-4682-a58d-1762f09ff0b1 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:15.401364 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-dab26ae5-7bdd-4682-a58d-1762f09ff0b1 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:15.402131 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-dab26ae5-7bdd-4682-a58d-1762f09ff0b1 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:15.402565 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-dab26ae5-7bdd-4682-a58d-1762f09ff0b1 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:15.530030 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-dab26ae5-7bdd-4682-a58d-1762f09ff0b1 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:15.538317 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-dab26ae5-7bdd-4682-a58d-1762f09ff0b1 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:15.539849 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-dab26ae5-7bdd-4682-a58d-1762f09ff0b1 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:15.540996 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-dab26ae5-7bdd-4682-a58d-1762f09ff0b1 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a" status: 200 len: 1722 microversion: 2.20 time: 0.151387 Jul 21 20:14:15.541551 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 444/869] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:14:15 2022] GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:14:15.565477 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-c0b526b5-1c9e-4a82-99ce-f85437f046af tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:14:15.566073 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-c0b526b5-1c9e-4a82-99ce-f85437f046af tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] [instance: 301ed3ad-5cb4-4ebf-ac32-519ab482cdea] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:14:15.572498 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-c0b526b5-1c9e-4a82-99ce-f85437f046af tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:15.572965 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-c0b526b5-1c9e-4a82-99ce-f85437f046af tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:15.573708 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-c0b526b5-1c9e-4a82-99ce-f85437f046af tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:15.574132 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-c0b526b5-1c9e-4a82-99ce-f85437f046af tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:15.635474 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-c0b526b5-1c9e-4a82-99ce-f85437f046af tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf78e0fe86d4e078c0527248af45cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4239f4ae39bb49cf8063377a93875456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:15.643671 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-c0b526b5-1c9e-4a82-99ce-f85437f046af tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] 10.222.0.58 "GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea" status: 200 len: 1382 microversion: 2.1 time: 0.081980 Jul 21 20:14:15.644163 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 426/870] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:14:15 2022] GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea => generated 1382 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:14:15.987638 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-f60f1d8e-963f-4717-b286-a560c717e6e5 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:14:15.988165 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-f60f1d8e-963f-4717-b286-a560c717e6e5 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 392749b4-22f6-470d-9b2e-4a9b2ded152b] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:14:15.994134 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f60f1d8e-963f-4717-b286-a560c717e6e5 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:15.994572 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f60f1d8e-963f-4717-b286-a560c717e6e5 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:15.995353 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f60f1d8e-963f-4717-b286-a560c717e6e5 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:15.995788 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f60f1d8e-963f-4717-b286-a560c717e6e5 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:16.120871 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-f60f1d8e-963f-4717-b286-a560c717e6e5 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:16.128659 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-f60f1d8e-963f-4717-b286-a560c717e6e5 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/392749b4-22f6-470d-9b2e-4a9b2ded152b" status: 200 len: 1368 microversion: 2.1 time: 0.144927 Jul 21 20:14:16.129220 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 445/871] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:14:15 2022] GET /compute/v2.1/servers/392749b4-22f6-470d-9b2e-4a9b2ded152b => generated 1368 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:14:16.559623 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-6f2597aa-68bc-429b-a3ad-3aa138355237 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:14:16.560223 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-6f2597aa-68bc-429b-a3ad-3aa138355237 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: 5610f3fc-4e8b-48c0-a628-4b5c9419635a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:14:16.566868 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-6f2597aa-68bc-429b-a3ad-3aa138355237 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:16.567481 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-6f2597aa-68bc-429b-a3ad-3aa138355237 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:16.568087 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-6f2597aa-68bc-429b-a3ad-3aa138355237 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:16.568508 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-6f2597aa-68bc-429b-a3ad-3aa138355237 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:16.661044 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-8cfbddfa-1fb4-4f51-b3f1-05ecd6851d63 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:14:16.661658 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-8cfbddfa-1fb4-4f51-b3f1-05ecd6851d63 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] [instance: 301ed3ad-5cb4-4ebf-ac32-519ab482cdea] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:14:16.667750 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8cfbddfa-1fb4-4f51-b3f1-05ecd6851d63 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:16.668202 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8cfbddfa-1fb4-4f51-b3f1-05ecd6851d63 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:16.668973 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8cfbddfa-1fb4-4f51-b3f1-05ecd6851d63 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:16.669411 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8cfbddfa-1fb4-4f51-b3f1-05ecd6851d63 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:16.697009 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-6f2597aa-68bc-429b-a3ad-3aa138355237 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:16.705616 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-6f2597aa-68bc-429b-a3ad-3aa138355237 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:16.707383 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-6f2597aa-68bc-429b-a3ad-3aa138355237 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:16.708645 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-6f2597aa-68bc-429b-a3ad-3aa138355237 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a" status: 200 len: 1722 microversion: 2.20 time: 0.152906 Jul 21 20:14:16.709270 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 427/872] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:14:16 2022] GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:14:16.733914 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-8cfbddfa-1fb4-4f51-b3f1-05ecd6851d63 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf78e0fe86d4e078c0527248af45cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4239f4ae39bb49cf8063377a93875456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:16.741404 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-8cfbddfa-1fb4-4f51-b3f1-05ecd6851d63 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] 10.222.0.58 "GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea" status: 200 len: 1382 microversion: 2.1 time: 0.084733 Jul 21 20:14:16.741968 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 446/873] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:14:16 2022] GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea => generated 1382 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:14:17.146043 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-861a974d-e688-4eb3-9f55-31d11de06fc8 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:14:17.146782 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-861a974d-e688-4eb3-9f55-31d11de06fc8 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 392749b4-22f6-470d-9b2e-4a9b2ded152b] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:14:17.152811 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-861a974d-e688-4eb3-9f55-31d11de06fc8 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:17.153259 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-861a974d-e688-4eb3-9f55-31d11de06fc8 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:17.154019 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-861a974d-e688-4eb3-9f55-31d11de06fc8 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:17.154452 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-861a974d-e688-4eb3-9f55-31d11de06fc8 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:17.284826 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-861a974d-e688-4eb3-9f55-31d11de06fc8 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:17.292355 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-861a974d-e688-4eb3-9f55-31d11de06fc8 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/392749b4-22f6-470d-9b2e-4a9b2ded152b" status: 200 len: 1368 microversion: 2.1 time: 0.150855 Jul 21 20:14:17.292925 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 428/874] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:14:17 2022] GET /compute/v2.1/servers/392749b4-22f6-470d-9b2e-4a9b2ded152b => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:14:17.727218 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-f6d6325d-32b9-4943-854a-cf4ba149dbeb tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:14:17.727755 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-f6d6325d-32b9-4943-854a-cf4ba149dbeb tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: 5610f3fc-4e8b-48c0-a628-4b5c9419635a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:14:17.733732 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f6d6325d-32b9-4943-854a-cf4ba149dbeb tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:17.734177 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f6d6325d-32b9-4943-854a-cf4ba149dbeb tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:17.735562 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f6d6325d-32b9-4943-854a-cf4ba149dbeb tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:17.736032 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f6d6325d-32b9-4943-854a-cf4ba149dbeb tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:17.758408 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-5d149695-cc70-489d-b215-7aed425995f1 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:14:17.759007 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-5d149695-cc70-489d-b215-7aed425995f1 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] [instance: 301ed3ad-5cb4-4ebf-ac32-519ab482cdea] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:14:17.765369 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-5d149695-cc70-489d-b215-7aed425995f1 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:17.765806 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-5d149695-cc70-489d-b215-7aed425995f1 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:17.766564 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-5d149695-cc70-489d-b215-7aed425995f1 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:17.766982 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-5d149695-cc70-489d-b215-7aed425995f1 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:17.828609 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-5d149695-cc70-489d-b215-7aed425995f1 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf78e0fe86d4e078c0527248af45cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4239f4ae39bb49cf8063377a93875456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:17.836181 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-5d149695-cc70-489d-b215-7aed425995f1 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] 10.222.0.58 "GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea" status: 200 len: 1382 microversion: 2.1 time: 0.081572 Jul 21 20:14:17.836746 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 429/875] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:14:17 2022] GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea => generated 1382 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:14:17.865058 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-f6d6325d-32b9-4943-854a-cf4ba149dbeb tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:17.875547 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-f6d6325d-32b9-4943-854a-cf4ba149dbeb tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:17.877023 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-f6d6325d-32b9-4943-854a-cf4ba149dbeb tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:17.878158 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-f6d6325d-32b9-4943-854a-cf4ba149dbeb tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a" status: 200 len: 1722 microversion: 2.20 time: 0.155012 Jul 21 20:14:17.878704 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 447/876] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:14:17 2022] GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:14:18.309670 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-8f5be999-907e-47a9-8250-c0e140b91ae9 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:14:18.310279 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-8f5be999-907e-47a9-8250-c0e140b91ae9 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 392749b4-22f6-470d-9b2e-4a9b2ded152b] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:14:18.317003 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-8f5be999-907e-47a9-8250-c0e140b91ae9 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:18.317451 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-8f5be999-907e-47a9-8250-c0e140b91ae9 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:18.318215 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-8f5be999-907e-47a9-8250-c0e140b91ae9 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:18.318648 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-8f5be999-907e-47a9-8250-c0e140b91ae9 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:18.446012 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-8f5be999-907e-47a9-8250-c0e140b91ae9 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:18.453367 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-8f5be999-907e-47a9-8250-c0e140b91ae9 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/392749b4-22f6-470d-9b2e-4a9b2ded152b" status: 200 len: 1368 microversion: 2.1 time: 0.147608 Jul 21 20:14:18.454577 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 430/877] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:14:18 2022] GET /compute/v2.1/servers/392749b4-22f6-470d-9b2e-4a9b2ded152b => generated 1368 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:14:18.853744 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-0fb86683-63de-4e9a-a4eb-7d092d804554 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:14:18.854340 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-0fb86683-63de-4e9a-a4eb-7d092d804554 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] [instance: 301ed3ad-5cb4-4ebf-ac32-519ab482cdea] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:14:18.860920 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0fb86683-63de-4e9a-a4eb-7d092d804554 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:18.861356 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0fb86683-63de-4e9a-a4eb-7d092d804554 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:18.862099 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0fb86683-63de-4e9a-a4eb-7d092d804554 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:18.862524 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0fb86683-63de-4e9a-a4eb-7d092d804554 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:18.901277 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-4119999c-e412-4fa6-8813-8ab853a57e33 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:14:18.901786 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-4119999c-e412-4fa6-8813-8ab853a57e33 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: 5610f3fc-4e8b-48c0-a628-4b5c9419635a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:14:18.908448 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-4119999c-e412-4fa6-8813-8ab853a57e33 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:18.908896 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-4119999c-e412-4fa6-8813-8ab853a57e33 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:18.909668 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-4119999c-e412-4fa6-8813-8ab853a57e33 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:18.910106 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-4119999c-e412-4fa6-8813-8ab853a57e33 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:18.927520 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-0fb86683-63de-4e9a-a4eb-7d092d804554 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf78e0fe86d4e078c0527248af45cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4239f4ae39bb49cf8063377a93875456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:18.934887 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-0fb86683-63de-4e9a-a4eb-7d092d804554 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] 10.222.0.58 "GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea" status: 200 len: 1382 microversion: 2.1 time: 0.085059 Jul 21 20:14:18.935478 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 448/878] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:14:18 2022] GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea => generated 1382 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:14:19.040748 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-4119999c-e412-4fa6-8813-8ab853a57e33 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:19.049463 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-4119999c-e412-4fa6-8813-8ab853a57e33 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:19.050934 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-4119999c-e412-4fa6-8813-8ab853a57e33 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:19.052135 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-4119999c-e412-4fa6-8813-8ab853a57e33 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a" status: 200 len: 1722 microversion: 2.20 time: 0.154860 Jul 21 20:14:19.052696 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 431/879] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:14:18 2022] GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 20:14:19.471650 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-c32be825-634a-4d4d-81be-d3c3d1392579 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:14:19.472184 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-c32be825-634a-4d4d-81be-d3c3d1392579 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 392749b4-22f6-470d-9b2e-4a9b2ded152b] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:14:19.478153 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c32be825-634a-4d4d-81be-d3c3d1392579 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:19.478591 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c32be825-634a-4d4d-81be-d3c3d1392579 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:19.479370 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c32be825-634a-4d4d-81be-d3c3d1392579 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:19.479799 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c32be825-634a-4d4d-81be-d3c3d1392579 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:19.608987 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-c32be825-634a-4d4d-81be-d3c3d1392579 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:19.616256 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-c32be825-634a-4d4d-81be-d3c3d1392579 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/392749b4-22f6-470d-9b2e-4a9b2ded152b" status: 200 len: 1368 microversion: 2.1 time: 0.149589 Jul 21 20:14:19.616819 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 449/880] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:14:19 2022] GET /compute/v2.1/servers/392749b4-22f6-470d-9b2e-4a9b2ded152b => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:14:19.952548 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-641e259c-5087-4616-879d-ba95298e5b2e tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:14:19.953157 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-641e259c-5087-4616-879d-ba95298e5b2e tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] [instance: 301ed3ad-5cb4-4ebf-ac32-519ab482cdea] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:14:19.960459 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-641e259c-5087-4616-879d-ba95298e5b2e tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:19.960896 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-641e259c-5087-4616-879d-ba95298e5b2e tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:19.961673 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-641e259c-5087-4616-879d-ba95298e5b2e tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:19.962096 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-641e259c-5087-4616-879d-ba95298e5b2e tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:20.031644 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-641e259c-5087-4616-879d-ba95298e5b2e tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf78e0fe86d4e078c0527248af45cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4239f4ae39bb49cf8063377a93875456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:20.039401 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-641e259c-5087-4616-879d-ba95298e5b2e tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] 10.222.0.58 "GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea" status: 200 len: 1220 microversion: 2.1 time: 0.090694 Jul 21 20:14:20.040102 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 432/881] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:14:19 2022] GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea => generated 1220 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:14:20.060755 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [req-cf12192f-0997-40c1-bb8f-28dcd5229405 req-9b4f15ab-7a48-4418-862d-a67d5d35ab59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5610f3fc-4e8b-48c0-a628-4b5c9419635a", "name": "network-vif-unplugged", "status": "completed", "tag": "c9b7a4f8-5df1-449c-9157-130a564accea"}]} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:14:20.069371 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-cf12192f-0997-40c1-bb8f-28dcd5229405 req-9b4f15ab-7a48-4418-862d-a67d5d35ab59 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:20.069810 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-cf12192f-0997-40c1-bb8f-28dcd5229405 req-9b4f15ab-7a48-4418-862d-a67d5d35ab59 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:20.070182 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-f7f2f40f-2e88-43c9-84af-73e8fa18cb39 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:14:20.070784 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-f7f2f40f-2e88-43c9-84af-73e8fa18cb39 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: 5610f3fc-4e8b-48c0-a628-4b5c9419635a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:14:20.077595 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f7f2f40f-2e88-43c9-84af-73e8fa18cb39 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:20.078240 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f7f2f40f-2e88-43c9-84af-73e8fa18cb39 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:20.079597 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f7f2f40f-2e88-43c9-84af-73e8fa18cb39 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:20.080260 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f7f2f40f-2e88-43c9-84af-73e8fa18cb39 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:20.081728 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.compute.server_external_events [req-cf12192f-0997-40c1-bb8f-28dcd5229405 req-9b4f15ab-7a48-4418-862d-a67d5d35ab59 service nova] Creating event network-vif-unplugged:c9b7a4f8-5df1-449c-9157-130a564accea for instance 5610f3fc-4e8b-48c0-a628-4b5c9419635a on hv-cinder-85054 Jul 21 20:14:20.086585 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [req-cf12192f-0997-40c1-bb8f-28dcd5229405 req-9b4f15ab-7a48-4418-862d-a67d5d35ab59 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029464 Jul 21 20:14:20.087802 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 450/882] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 20:14:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:14:20.215622 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-f7f2f40f-2e88-43c9-84af-73e8fa18cb39 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:20.225587 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-f7f2f40f-2e88-43c9-84af-73e8fa18cb39 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:20.227144 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-f7f2f40f-2e88-43c9-84af-73e8fa18cb39 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:20.228298 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-f7f2f40f-2e88-43c9-84af-73e8fa18cb39 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a" status: 200 len: 1722 microversion: 2.20 time: 0.162155 Jul 21 20:14:20.228850 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 433/883] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:14:20 2022] GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:14:20.633348 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-0499f0c1-769d-4ebb-b98d-c45127f0836f tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:14:20.634045 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-0499f0c1-769d-4ebb-b98d-c45127f0836f tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 392749b4-22f6-470d-9b2e-4a9b2ded152b] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:14:20.640297 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0499f0c1-769d-4ebb-b98d-c45127f0836f tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:20.640744 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0499f0c1-769d-4ebb-b98d-c45127f0836f tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:20.641864 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0499f0c1-769d-4ebb-b98d-c45127f0836f tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:20.642541 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0499f0c1-769d-4ebb-b98d-c45127f0836f tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:20.776659 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-0499f0c1-769d-4ebb-b98d-c45127f0836f tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:20.785011 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-0499f0c1-769d-4ebb-b98d-c45127f0836f tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/392749b4-22f6-470d-9b2e-4a9b2ded152b" status: 200 len: 1368 microversion: 2.1 time: 0.155861 Jul 21 20:14:20.785586 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 451/884] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:14:20 2022] GET /compute/v2.1/servers/392749b4-22f6-470d-9b2e-4a9b2ded152b => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:14:21.056662 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-8916157a-0bd5-4085-b797-5311234359df tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:14:21.057211 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-8916157a-0bd5-4085-b797-5311234359df tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] [instance: 301ed3ad-5cb4-4ebf-ac32-519ab482cdea] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:14:21.065442 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-8916157a-0bd5-4085-b797-5311234359df tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:21.066051 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-8916157a-0bd5-4085-b797-5311234359df tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:21.066961 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-8916157a-0bd5-4085-b797-5311234359df tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:21.067457 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-8916157a-0bd5-4085-b797-5311234359df tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:21.130059 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-8916157a-0bd5-4085-b797-5311234359df tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf78e0fe86d4e078c0527248af45cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4239f4ae39bb49cf8063377a93875456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:21.138541 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-8916157a-0bd5-4085-b797-5311234359df tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] 10.222.0.58 "GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea" status: 200 len: 1220 microversion: 2.1 time: 0.085974 Jul 21 20:14:21.139554 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 434/885] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:14:21 2022] GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:14:21.247150 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-f44f56c2-d234-437c-a37c-041af7ac9f9d tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:14:21.247854 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-f44f56c2-d234-437c-a37c-041af7ac9f9d tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: 5610f3fc-4e8b-48c0-a628-4b5c9419635a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:14:21.254716 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f44f56c2-d234-437c-a37c-041af7ac9f9d tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:21.255191 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f44f56c2-d234-437c-a37c-041af7ac9f9d tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:21.255957 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f44f56c2-d234-437c-a37c-041af7ac9f9d tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:21.256386 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f44f56c2-d234-437c-a37c-041af7ac9f9d tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:21.389871 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-f44f56c2-d234-437c-a37c-041af7ac9f9d tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:21.393453 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell1:SELECT=100 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:14:21.398627 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-f44f56c2-d234-437c-a37c-041af7ac9f9d tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:21.400853 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-f44f56c2-d234-437c-a37c-041af7ac9f9d tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:21.402381 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-f44f56c2-d234-437c-a37c-041af7ac9f9d tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a" status: 200 len: 1725 microversion: 2.20 time: 0.159168 Jul 21 20:14:21.403110 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 452/886] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:14:21 2022] GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:14:21.424690 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-fec41633-8e57-4d47-83a3-37b78c0db8b6 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "82b057c8-e7d8-420b-abc9-5ad06cccb463"}} {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:14:21.425840 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-fec41633-8e57-4d47-83a3-37b78c0db8b6 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: 5610f3fc-4e8b-48c0-a628-4b5c9419635a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:14:21.432138 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-fec41633-8e57-4d47-83a3-37b78c0db8b6 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:21.432612 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-fec41633-8e57-4d47-83a3-37b78c0db8b6 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:21.433390 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-fec41633-8e57-4d47-83a3-37b78c0db8b6 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:21.433825 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-fec41633-8e57-4d47-83a3-37b78c0db8b6 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:21.802587 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-b3a01617-58b4-4723-88d8-1d51fd1d2b97 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:14:21.803224 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-b3a01617-58b4-4723-88d8-1d51fd1d2b97 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 392749b4-22f6-470d-9b2e-4a9b2ded152b] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:14:21.809389 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b3a01617-58b4-4723-88d8-1d51fd1d2b97 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:21.809834 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b3a01617-58b4-4723-88d8-1d51fd1d2b97 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:21.810589 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b3a01617-58b4-4723-88d8-1d51fd1d2b97 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:21.811027 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b3a01617-58b4-4723-88d8-1d51fd1d2b97 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:21.943687 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-b3a01617-58b4-4723-88d8-1d51fd1d2b97 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:21.951117 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-b3a01617-58b4-4723-88d8-1d51fd1d2b97 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/392749b4-22f6-470d-9b2e-4a9b2ded152b" status: 200 len: 1558 microversion: 2.1 time: 0.152694 Jul 21 20:14:21.951686 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 453/887] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:14:21 2022] GET /compute/v2.1/servers/392749b4-22f6-470d-9b2e-4a9b2ded152b => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:14:21.966811 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-3511d566-5c39-4523-9653-bd96379fc920 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:14:21.967394 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-3511d566-5c39-4523-9653-bd96379fc920 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 392749b4-22f6-470d-9b2e-4a9b2ded152b] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:14:21.973504 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3511d566-5c39-4523-9653-bd96379fc920 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:21.973942 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3511d566-5c39-4523-9653-bd96379fc920 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:21.974687 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3511d566-5c39-4523-9653-bd96379fc920 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:21.975132 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3511d566-5c39-4523-9653-bd96379fc920 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:22.062287 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-3511d566-5c39-4523-9653-bd96379fc920 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/392749b4-22f6-470d-9b2e-4a9b2ded152b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099033 Jul 21 20:14:22.063505 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 454/888] 10.222.0.58 () {58 vars in 1274 bytes} [Thu Jul 21 20:14:21 2022] GET /compute/v2.1/servers/392749b4-22f6-470d-9b2e-4a9b2ded152b/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 20:14:22.155006 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-e6d3028b-c0f4-4dba-b3ef-359c93b08e8e tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:14:22.155644 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-e6d3028b-c0f4-4dba-b3ef-359c93b08e8e tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] [instance: 301ed3ad-5cb4-4ebf-ac32-519ab482cdea] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:14:22.162828 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e6d3028b-c0f4-4dba-b3ef-359c93b08e8e tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:22.163334 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e6d3028b-c0f4-4dba-b3ef-359c93b08e8e tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:22.164107 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e6d3028b-c0f4-4dba-b3ef-359c93b08e8e tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:22.164539 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e6d3028b-c0f4-4dba-b3ef-359c93b08e8e tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:22.197502 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e6d3028b-c0f4-4dba-b3ef-359c93b08e8e tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:22.197942 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e6d3028b-c0f4-4dba-b3ef-359c93b08e8e tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:22.198381 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.objects.instance [None req-e6d3028b-c0f4-4dba-b3ef-359c93b08e8e tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lazy-loading 'fault' on Instance uuid 301ed3ad-5cb4-4ebf-ac32-519ab482cdea {{(pid=118345) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 20:14:22.244887 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-e6d3028b-c0f4-4dba-b3ef-359c93b08e8e tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf78e0fe86d4e078c0527248af45cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4239f4ae39bb49cf8063377a93875456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:22.253161 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-e6d3028b-c0f4-4dba-b3ef-359c93b08e8e tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] 10.222.0.58 "GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea" status: 200 len: 1225 microversion: 2.1 time: 0.101981 Jul 21 20:14:22.262719 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 455/889] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:14:22 2022] GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea => generated 1225 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:14:22.397740 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG dbcounter [-] [118344] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=118344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:14:22.479637 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-fec41633-8e57-4d47-83a3-37b78c0db8b6 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "POST /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.059462 Jul 21 20:14:22.480351 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 435/890] 10.222.0.58 () {62 vars in 1363 bytes} [Thu Jul 21 20:14:21 2022] POST /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a/os-volume_attachments => generated 188 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 20:14:22.613262 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-03367149-c633-48a7-8c09-888fb9e00167 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:14:22.614081 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-03367149-c633-48a7-8c09-888fb9e00167 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: 5610f3fc-4e8b-48c0-a628-4b5c9419635a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:14:22.620401 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-03367149-c633-48a7-8c09-888fb9e00167 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:22.620927 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-03367149-c633-48a7-8c09-888fb9e00167 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:22.621774 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-03367149-c633-48a7-8c09-888fb9e00167 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:22.622274 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-03367149-c633-48a7-8c09-888fb9e00167 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:23.102552 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [req-ab484e1f-71c3-4907-a51e-2f7864c01290 req-af750db0-419f-4e3d-b7aa-208bd56d133a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "392749b4-22f6-470d-9b2e-4a9b2ded152b", "tag": "a0a4f662-60e3-4ba4-829f-a5e0a18505d8"}]} {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:14:23.113339 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [req-ab484e1f-71c3-4907-a51e-2f7864c01290 req-af750db0-419f-4e3d-b7aa-208bd56d133a service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:23.114002 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [req-ab484e1f-71c3-4907-a51e-2f7864c01290 req-af750db0-419f-4e3d-b7aa-208bd56d133a service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:23.124490 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.compute.server_external_events [req-ab484e1f-71c3-4907-a51e-2f7864c01290 req-af750db0-419f-4e3d-b7aa-208bd56d133a service nova] Creating event network-changed:a0a4f662-60e3-4ba4-829f-a5e0a18505d8 for instance 392749b4-22f6-470d-9b2e-4a9b2ded152b on hv-cinder-85054 Jul 21 20:14:23.130055 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [req-ab484e1f-71c3-4907-a51e-2f7864c01290 req-af750db0-419f-4e3d-b7aa-208bd56d133a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031252 Jul 21 20:14:23.130660 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 436/891] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 20:14:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:14:23.270234 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-648084a7-91ad-4b27-9b2a-63b7b962a767 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:14:23.270941 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-648084a7-91ad-4b27-9b2a-63b7b962a767 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] [instance: 301ed3ad-5cb4-4ebf-ac32-519ab482cdea] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:14:23.277704 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-648084a7-91ad-4b27-9b2a-63b7b962a767 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:23.278144 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-648084a7-91ad-4b27-9b2a-63b7b962a767 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:23.278908 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-648084a7-91ad-4b27-9b2a-63b7b962a767 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:23.279358 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-648084a7-91ad-4b27-9b2a-63b7b962a767 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:23.292934 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.wsgi [None req-648084a7-91ad-4b27-9b2a-63b7b962a767 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] HTTP exception thrown: Instance 301ed3ad-5cb4-4ebf-ac32-519ab482cdea could not be found. Jul 21 20:14:23.295612 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-648084a7-91ad-4b27-9b2a-63b7b962a767 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Request method failure captured: Jul 21 20:14:23.295612 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: request: GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea HTTP/1.1 Jul 21 20:14:23.295612 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Accept: application/json Jul 21 20:14:23.295612 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Accept-Encoding: identity Jul 21 20:14:23.295612 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Connection: close Jul 21 20:14:23.295612 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Content-Length: 0 Jul 21 20:14:23.295612 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Content-Type: application/json Jul 21 20:14:23.295612 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Host: 10.222.0.58 Jul 21 20:14:23.295612 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Openstack-System-Scope: None Jul 21 20:14:23.295612 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: User-Agent: python-urllib3/1.26.9 Jul 21 20:14:23.295612 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Auth-Token: gAAAAABi2bIT_gAkhsOiKyVf1sxbgncr2peJe-DksUTxMc-sFZJYAUsX6Lb88CSGPS5en5YWk_rxF0QnXggBtmiCIKwmHtRwDnBXGxKrxDeFaE0gfL4Wbqd47SJ1Tx4xWBFtRxXEtXsTdWnzfjZ9xMZNxCbHxYjHhhbfrRjXmQPlmu5KIwGDKeA Jul 21 20:14:23.295612 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Domain-Id: None Jul 21 20:14:23.295612 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Domain-Name: None Jul 21 20:14:23.295612 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Identity-Status: Confirmed Jul 21 20:14:23.295612 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Is-Admin-Project: True Jul 21 20:14:23.295612 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Domain-Id: default Jul 21 20:14:23.295612 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Domain-Name: Default Jul 21 20:14:23.295612 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Id: 4239f4ae39bb49cf8063377a93875456 Jul 21 20:14:23.295612 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Name: tempest-TestShelveInstance-939286616 Jul 21 20:14:23.295612 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Role: reader,member Jul 21 20:14:23.295612 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Roles: reader,member Jul 21 20:14:23.297821 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/4239f4ae39bb49cf8063377a93875456"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4239f4ae39bb49cf8063377a93875456"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_4239f4ae39bb49cf8063377a93875456"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4239f4ae39bb49cf8063377a93875456"}]}] Jul 21 20:14:23.297821 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Tenant: tempest-TestShelveInstance-939286616 Jul 21 20:14:23.297821 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Tenant-Id: 4239f4ae39bb49cf8063377a93875456 Jul 21 20:14:23.297821 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Tenant-Name: tempest-TestShelveInstance-939286616 Jul 21 20:14:23.297821 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User: tempest-TestShelveInstance-939286616-project Jul 21 20:14:23.297821 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Domain-Id: default Jul 21 20:14:23.297821 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Domain-Name: Default Jul 21 20:14:23.297821 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Id: 4bf78e0fe86d4e078c0527248af45cb4 Jul 21 20:14:23.297821 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Name: tempest-TestShelveInstance-939286616-project Jul 21 20:14:23.297821 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: method: > Jul 21 20:14:23.297821 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: exception: Instance 301ed3ad-5cb4-4ebf-ac32-519ab482cdea could not be found. Jul 21 20:14:23.297821 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: action_args: {'id': '301ed3ad-5cb4-4ebf-ac32-519ab482cdea'} Jul 21 20:14:23.298802 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 20:14:23.298802 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:14:23.298802 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 20:14:23.298802 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 20:14:23.298802 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 20:14:23.298802 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 20:14:23.298802 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 20:14:23.298802 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 20:14:23.298802 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 20:14:23.298802 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 20:14:23.298802 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 301ed3ad-5cb4-4ebf-ac32-519ab482cdea could not be found. Jul 21 20:14:23.298802 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:14:23.298802 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:14:23.298802 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:14:23.298802 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:14:23.298802 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:14:23.298802 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:14:23.298802 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 20:14:23.298802 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 20:14:23.298802 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 20:14:23.300075 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 20:14:23.300075 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 20:14:23.300075 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 20:14:23.300075 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 20:14:23.300075 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 20:14:23.300075 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 20:14:23.300075 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 20:14:23.300075 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 301ed3ad-5cb4-4ebf-ac32-519ab482cdea could not be found. Jul 21 20:14:23.300075 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:14:23.300075 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:14:23.300075 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:14:23.300075 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:14:23.300075 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:14:23.300075 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:14:23.300075 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 20:14:23.300075 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 20:14:23.300075 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 301ed3ad-5cb4-4ebf-ac32-519ab482cdea could not be found. Jul 21 20:14:23.300075 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:14:23.301219 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-648084a7-91ad-4b27-9b2a-63b7b962a767 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Returning 404 to user: Instance 301ed3ad-5cb4-4ebf-ac32-519ab482cdea could not be found. {{(pid=118344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 20:14:23.301219 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-648084a7-91ad-4b27-9b2a-63b7b962a767 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] 10.222.0.58 "GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea" status: 404 len: 111 microversion: 2.1 time: 0.031044 Jul 21 20:14:23.301219 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 437/892] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:14:23 2022] GET /compute/v2.1/servers/301ed3ad-5cb4-4ebf-ac32-519ab482cdea => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 21 20:14:23.318187 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-03367149-c633-48a7-8c09-888fb9e00167 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "DELETE /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a/os-volume_attachments/82b057c8-e7d8-420b-abc9-5ad06cccb463" status: 202 len: 0 microversion: 2.20 time: 0.708683 Jul 21 20:14:23.321541 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 456/893] 10.222.0.58 () {60 vars in 1456 bytes} [Thu Jul 21 20:14:22 2022] DELETE /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a/os-volume_attachments/82b057c8-e7d8-420b-abc9-5ad06cccb463 => generated 0 bytes in 713 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 21 20:14:23.380929 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-b2135526-0ce3-4f82-96e1-52dd3753b1f7 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:14:23.381732 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-b2135526-0ce3-4f82-96e1-52dd3753b1f7 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: 5610f3fc-4e8b-48c0-a628-4b5c9419635a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:14:23.389613 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-b2135526-0ce3-4f82-96e1-52dd3753b1f7 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:23.390308 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-b2135526-0ce3-4f82-96e1-52dd3753b1f7 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:23.391698 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-b2135526-0ce3-4f82-96e1-52dd3753b1f7 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:23.392240 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-b2135526-0ce3-4f82-96e1-52dd3753b1f7 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:23.598045 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-717152bd-4f28-4441-bcfa-3867b4ba8353 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] Calling method '.version_select at 0x7f351cc1d280>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:14:23.646895 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-b2135526-0ce3-4f82-96e1-52dd3753b1f7 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "POST /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a/action" status: 202 len: 0 microversion: 2.20 time: 0.269479 Jul 21 20:14:23.647658 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 438/894] 10.222.0.58 () {62 vars in 1318 bytes} [Thu Jul 21 20:14:23 2022] POST /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a/action => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 21 20:14:23.664580 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-9e469aa0-4474-4a7f-9199-353aeaee0d9f tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:14:23.665498 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-9e469aa0-4474-4a7f-9199-353aeaee0d9f tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: 5610f3fc-4e8b-48c0-a628-4b5c9419635a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:14:23.675255 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-9e469aa0-4474-4a7f-9199-353aeaee0d9f tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:23.675255 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-9e469aa0-4474-4a7f-9199-353aeaee0d9f tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:23.675255 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-9e469aa0-4474-4a7f-9199-353aeaee0d9f tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:23.675255 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-9e469aa0-4474-4a7f-9199-353aeaee0d9f tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:23.696560 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-717152bd-4f28-4441-bcfa-3867b4ba8353 tempest-TestShelveInstance-939286616 tempest-TestShelveInstance-939286616-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1680681615" status: 202 len: 0 microversion: 2.1 time: 0.103126 Jul 21 20:14:23.697151 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 457/895] 10.222.0.58 () {58 vars in 1253 bytes} [Thu Jul 21 20:14:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1680681615 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 21 20:14:23.845512 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-9e469aa0-4474-4a7f-9199-353aeaee0d9f tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:23.860690 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-9e469aa0-4474-4a7f-9199-353aeaee0d9f tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:23.862198 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-9e469aa0-4474-4a7f-9199-353aeaee0d9f tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:23.863389 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-9e469aa0-4474-4a7f-9199-353aeaee0d9f tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a" status: 200 len: 1673 microversion: 2.20 time: 0.210799 Jul 21 20:14:23.864146 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 439/896] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:14:23 2022] GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a => generated 1673 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:14:24.882131 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-8f4ebaa4-7271-4839-b27d-f11e052dd73c tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:14:24.882728 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-8f4ebaa4-7271-4839-b27d-f11e052dd73c tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: 5610f3fc-4e8b-48c0-a628-4b5c9419635a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:14:24.889776 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8f4ebaa4-7271-4839-b27d-f11e052dd73c tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:24.890225 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8f4ebaa4-7271-4839-b27d-f11e052dd73c tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:24.891555 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8f4ebaa4-7271-4839-b27d-f11e052dd73c tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:24.891991 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8f4ebaa4-7271-4839-b27d-f11e052dd73c tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:25.054453 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-8f4ebaa4-7271-4839-b27d-f11e052dd73c tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:25.063975 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-8f4ebaa4-7271-4839-b27d-f11e052dd73c tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:25.065509 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-8f4ebaa4-7271-4839-b27d-f11e052dd73c tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:25.066717 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-8f4ebaa4-7271-4839-b27d-f11e052dd73c tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a" status: 200 len: 1673 microversion: 2.20 time: 0.188737 Jul 21 20:14:25.067636 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 458/897] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:14:24 2022] GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a => generated 1673 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 20:14:26.085657 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-91e6cf71-a0ea-48db-ba4d-650dabf618aa tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:14:26.086327 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-91e6cf71-a0ea-48db-ba4d-650dabf618aa tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: 5610f3fc-4e8b-48c0-a628-4b5c9419635a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:14:26.094301 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-91e6cf71-a0ea-48db-ba4d-650dabf618aa tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:26.094747 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-91e6cf71-a0ea-48db-ba4d-650dabf618aa tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:26.095912 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-91e6cf71-a0ea-48db-ba4d-650dabf618aa tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:26.096601 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-91e6cf71-a0ea-48db-ba4d-650dabf618aa tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:26.229553 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-91e6cf71-a0ea-48db-ba4d-650dabf618aa tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:26.238259 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-91e6cf71-a0ea-48db-ba4d-650dabf618aa tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:26.239920 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-91e6cf71-a0ea-48db-ba4d-650dabf618aa tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:26.241070 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-91e6cf71-a0ea-48db-ba4d-650dabf618aa tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a" status: 200 len: 1673 microversion: 2.20 time: 0.159355 Jul 21 20:14:26.241880 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 440/898] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:14:26 2022] GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a => generated 1673 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 20:14:27.261037 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-1aa7bed0-4b67-4889-bdce-8453c5a29316 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:14:27.262342 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-1aa7bed0-4b67-4889-bdce-8453c5a29316 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: 5610f3fc-4e8b-48c0-a628-4b5c9419635a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:14:27.269701 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1aa7bed0-4b67-4889-bdce-8453c5a29316 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:27.276736 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1aa7bed0-4b67-4889-bdce-8453c5a29316 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:27.277652 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1aa7bed0-4b67-4889-bdce-8453c5a29316 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:27.278103 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1aa7bed0-4b67-4889-bdce-8453c5a29316 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:27.532143 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-1aa7bed0-4b67-4889-bdce-8453c5a29316 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:27.540859 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-1aa7bed0-4b67-4889-bdce-8453c5a29316 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:27.542874 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-1aa7bed0-4b67-4889-bdce-8453c5a29316 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:27.544670 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-1aa7bed0-4b67-4889-bdce-8453c5a29316 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a" status: 200 len: 1673 microversion: 2.20 time: 0.287757 Jul 21 20:14:27.545718 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 459/899] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:14:27 2022] GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a => generated 1673 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:14:28.563868 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-c6b7d702-3ea6-4d72-8b35-f0a7b7611056 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:14:28.564481 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-c6b7d702-3ea6-4d72-8b35-f0a7b7611056 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: 5610f3fc-4e8b-48c0-a628-4b5c9419635a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:14:28.571181 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-c6b7d702-3ea6-4d72-8b35-f0a7b7611056 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:28.571637 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-c6b7d702-3ea6-4d72-8b35-f0a7b7611056 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:28.572415 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-c6b7d702-3ea6-4d72-8b35-f0a7b7611056 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:28.572848 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-c6b7d702-3ea6-4d72-8b35-f0a7b7611056 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:28.748156 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-c6b7d702-3ea6-4d72-8b35-f0a7b7611056 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:28.757281 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-c6b7d702-3ea6-4d72-8b35-f0a7b7611056 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:28.759112 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-c6b7d702-3ea6-4d72-8b35-f0a7b7611056 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:28.760307 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-c6b7d702-3ea6-4d72-8b35-f0a7b7611056 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a" status: 200 len: 1673 microversion: 2.20 time: 0.201098 Jul 21 20:14:28.761040 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 441/900] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:14:28 2022] GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a => generated 1673 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:14:29.779128 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-58e7b106-cc19-4df7-baef-29387546e25e tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:14:29.780353 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-58e7b106-cc19-4df7-baef-29387546e25e tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: 5610f3fc-4e8b-48c0-a628-4b5c9419635a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:14:29.786406 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-58e7b106-cc19-4df7-baef-29387546e25e tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:29.786852 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-58e7b106-cc19-4df7-baef-29387546e25e tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:29.787669 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-58e7b106-cc19-4df7-baef-29387546e25e tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:29.788103 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-58e7b106-cc19-4df7-baef-29387546e25e tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:30.049838 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-58e7b106-cc19-4df7-baef-29387546e25e tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:30.061107 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-58e7b106-cc19-4df7-baef-29387546e25e tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:30.063488 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-58e7b106-cc19-4df7-baef-29387546e25e tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:30.065274 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-58e7b106-cc19-4df7-baef-29387546e25e tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a" status: 200 len: 1731 microversion: 2.20 time: 0.290020 Jul 21 20:14:30.065938 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 460/901] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:14:29 2022] GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a => generated 1731 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:14:31.084461 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-d50c59c3-cae6-4770-a508-e31a3775d68c tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:14:31.090816 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-d50c59c3-cae6-4770-a508-e31a3775d68c tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: 5610f3fc-4e8b-48c0-a628-4b5c9419635a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:14:31.092656 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-d50c59c3-cae6-4770-a508-e31a3775d68c tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:31.093147 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-d50c59c3-cae6-4770-a508-e31a3775d68c tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:31.093919 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-d50c59c3-cae6-4770-a508-e31a3775d68c tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:31.094355 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-d50c59c3-cae6-4770-a508-e31a3775d68c tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:31.253948 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-d50c59c3-cae6-4770-a508-e31a3775d68c tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:31.265180 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-d50c59c3-cae6-4770-a508-e31a3775d68c tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:31.267891 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-d50c59c3-cae6-4770-a508-e31a3775d68c tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:31.271304 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-d50c59c3-cae6-4770-a508-e31a3775d68c tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a" status: 200 len: 1731 microversion: 2.20 time: 0.190742 Jul 21 20:14:31.274322 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 442/902] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:14:31 2022] GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a => generated 1731 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:14:32.292320 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-24bed24a-75e6-4d32-bcb9-79e3ea4e76df tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:14:32.292868 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-24bed24a-75e6-4d32-bcb9-79e3ea4e76df tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: 5610f3fc-4e8b-48c0-a628-4b5c9419635a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:14:32.308587 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-24bed24a-75e6-4d32-bcb9-79e3ea4e76df tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:32.309526 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-24bed24a-75e6-4d32-bcb9-79e3ea4e76df tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:32.314412 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-24bed24a-75e6-4d32-bcb9-79e3ea4e76df tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:32.316225 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-24bed24a-75e6-4d32-bcb9-79e3ea4e76df tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:32.491083 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-24bed24a-75e6-4d32-bcb9-79e3ea4e76df tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:32.502881 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-24bed24a-75e6-4d32-bcb9-79e3ea4e76df tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:32.504467 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-24bed24a-75e6-4d32-bcb9-79e3ea4e76df tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:32.505832 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-24bed24a-75e6-4d32-bcb9-79e3ea4e76df tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a" status: 200 len: 1731 microversion: 2.20 time: 0.217727 Jul 21 20:14:32.507082 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 461/903] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:14:32 2022] GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a => generated 1731 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 20:14:33.526562 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-c944d624-26ea-44c5-a58b-665714e79cb3 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:14:33.527198 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-c944d624-26ea-44c5-a58b-665714e79cb3 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: 5610f3fc-4e8b-48c0-a628-4b5c9419635a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:14:33.541793 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-c944d624-26ea-44c5-a58b-665714e79cb3 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:33.542248 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-c944d624-26ea-44c5-a58b-665714e79cb3 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:33.543193 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-c944d624-26ea-44c5-a58b-665714e79cb3 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:33.544042 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-c944d624-26ea-44c5-a58b-665714e79cb3 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:33.711869 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-c944d624-26ea-44c5-a58b-665714e79cb3 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:33.727535 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-c944d624-26ea-44c5-a58b-665714e79cb3 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:33.729614 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-c944d624-26ea-44c5-a58b-665714e79cb3 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:33.730902 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-c944d624-26ea-44c5-a58b-665714e79cb3 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a" status: 200 len: 1731 microversion: 2.20 time: 0.208433 Jul 21 20:14:33.731693 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 443/904] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:14:33 2022] GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a => generated 1731 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:14:34.749426 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-d9afe5c0-8129-4667-b30f-6fa7bfd5589c tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:14:34.750602 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-d9afe5c0-8129-4667-b30f-6fa7bfd5589c tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: 5610f3fc-4e8b-48c0-a628-4b5c9419635a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:14:34.757088 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d9afe5c0-8129-4667-b30f-6fa7bfd5589c tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:34.757688 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d9afe5c0-8129-4667-b30f-6fa7bfd5589c tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:34.758350 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d9afe5c0-8129-4667-b30f-6fa7bfd5589c tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:34.758789 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d9afe5c0-8129-4667-b30f-6fa7bfd5589c tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:34.962592 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-d9afe5c0-8129-4667-b30f-6fa7bfd5589c tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:34.970870 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-d9afe5c0-8129-4667-b30f-6fa7bfd5589c tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:34.972688 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-d9afe5c0-8129-4667-b30f-6fa7bfd5589c tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:34.973867 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-d9afe5c0-8129-4667-b30f-6fa7bfd5589c tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a" status: 200 len: 1731 microversion: 2.20 time: 0.228477 Jul 21 20:14:34.974424 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 462/905] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:14:34 2022] GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a => generated 1731 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:14:35.996606 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-9dfead48-32d9-44df-8077-6f3a64bd2ef2 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:14:35.996606 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-9dfead48-32d9-44df-8077-6f3a64bd2ef2 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: 5610f3fc-4e8b-48c0-a628-4b5c9419635a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:14:36.005137 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-9dfead48-32d9-44df-8077-6f3a64bd2ef2 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:36.005968 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-9dfead48-32d9-44df-8077-6f3a64bd2ef2 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:36.006925 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-9dfead48-32d9-44df-8077-6f3a64bd2ef2 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:36.007386 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-9dfead48-32d9-44df-8077-6f3a64bd2ef2 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:36.256333 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-9dfead48-32d9-44df-8077-6f3a64bd2ef2 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:36.267598 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-9dfead48-32d9-44df-8077-6f3a64bd2ef2 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:36.269112 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-9dfead48-32d9-44df-8077-6f3a64bd2ef2 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:36.277140 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-9dfead48-32d9-44df-8077-6f3a64bd2ef2 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a" status: 200 len: 1731 microversion: 2.20 time: 0.287496 Jul 21 20:14:36.279773 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 444/906] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:14:35 2022] GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a => generated 1731 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:14:37.297848 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-a39f6859-7938-4647-95a6-c34bc3968abd tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:14:37.299190 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-a39f6859-7938-4647-95a6-c34bc3968abd tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: 5610f3fc-4e8b-48c0-a628-4b5c9419635a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:14:37.307993 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:14:37.311267 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a39f6859-7938-4647-95a6-c34bc3968abd tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:37.315824 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a39f6859-7938-4647-95a6-c34bc3968abd tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:37.315824 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a39f6859-7938-4647-95a6-c34bc3968abd tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:37.318544 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a39f6859-7938-4647-95a6-c34bc3968abd tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:37.555400 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-a39f6859-7938-4647-95a6-c34bc3968abd tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:37.569019 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-a39f6859-7938-4647-95a6-c34bc3968abd tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:37.570852 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-a39f6859-7938-4647-95a6-c34bc3968abd tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:37.572286 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-a39f6859-7938-4647-95a6-c34bc3968abd tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a" status: 200 len: 1731 microversion: 2.20 time: 0.278473 Jul 21 20:14:37.574032 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 463/907] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:14:37 2022] GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a => generated 1731 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:14:38.595561 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-4252866a-4e18-48a7-b39d-d9e4434b107f tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:14:38.597949 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-4252866a-4e18-48a7-b39d-d9e4434b107f tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: 5610f3fc-4e8b-48c0-a628-4b5c9419635a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:14:38.622175 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG dbcounter [-] [118344] Writing DB stats nova_api:SELECT=72 {{(pid=118344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:14:38.622175 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-4252866a-4e18-48a7-b39d-d9e4434b107f tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:38.622175 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-4252866a-4e18-48a7-b39d-d9e4434b107f tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:38.622175 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-4252866a-4e18-48a7-b39d-d9e4434b107f tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:38.622568 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-4252866a-4e18-48a7-b39d-d9e4434b107f tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:39.052212 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-4252866a-4e18-48a7-b39d-d9e4434b107f tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:39.060910 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-4252866a-4e18-48a7-b39d-d9e4434b107f tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:39.070470 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-4252866a-4e18-48a7-b39d-d9e4434b107f tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:39.072099 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-4252866a-4e18-48a7-b39d-d9e4434b107f tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a" status: 200 len: 1731 microversion: 2.20 time: 0.482198 Jul 21 20:14:39.074230 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 445/908] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:14:38 2022] GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a => generated 1731 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:14:40.094539 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-e7735349-a9b3-436d-a8e2-270e62857330 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:14:40.095258 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-e7735349-a9b3-436d-a8e2-270e62857330 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: 5610f3fc-4e8b-48c0-a628-4b5c9419635a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:14:40.102238 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e7735349-a9b3-436d-a8e2-270e62857330 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:40.102916 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e7735349-a9b3-436d-a8e2-270e62857330 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:40.103938 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e7735349-a9b3-436d-a8e2-270e62857330 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:40.104601 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e7735349-a9b3-436d-a8e2-270e62857330 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:40.617419 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-e7735349-a9b3-436d-a8e2-270e62857330 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:40.629460 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-e7735349-a9b3-436d-a8e2-270e62857330 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:40.631357 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-e7735349-a9b3-436d-a8e2-270e62857330 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:40.632624 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-e7735349-a9b3-436d-a8e2-270e62857330 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a" status: 200 len: 1731 microversion: 2.20 time: 0.544693 Jul 21 20:14:40.633277 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 464/909] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:14:40 2022] GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a => generated 1731 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:14:41.651953 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-48d9c32a-f08a-479d-ab10-8a38be8f0d00 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:14:41.652564 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-48d9c32a-f08a-479d-ab10-8a38be8f0d00 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: 5610f3fc-4e8b-48c0-a628-4b5c9419635a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:14:41.660041 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-48d9c32a-f08a-479d-ab10-8a38be8f0d00 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:41.660702 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-48d9c32a-f08a-479d-ab10-8a38be8f0d00 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:41.661478 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-48d9c32a-f08a-479d-ab10-8a38be8f0d00 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:41.661920 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-48d9c32a-f08a-479d-ab10-8a38be8f0d00 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:41.800055 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-48d9c32a-f08a-479d-ab10-8a38be8f0d00 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:41.809351 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-48d9c32a-f08a-479d-ab10-8a38be8f0d00 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:41.810848 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-48d9c32a-f08a-479d-ab10-8a38be8f0d00 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:41.812094 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-48d9c32a-f08a-479d-ab10-8a38be8f0d00 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a" status: 200 len: 1731 microversion: 2.20 time: 0.164208 Jul 21 20:14:41.813026 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 446/910] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:14:41 2022] GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a => generated 1731 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:14:42.830016 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-f9b1f3ae-d395-494a-bf6a-e8fca9116c4d tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:14:42.830694 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-f9b1f3ae-d395-494a-bf6a-e8fca9116c4d tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: 5610f3fc-4e8b-48c0-a628-4b5c9419635a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:14:42.837341 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f9b1f3ae-d395-494a-bf6a-e8fca9116c4d tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:42.837788 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f9b1f3ae-d395-494a-bf6a-e8fca9116c4d tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:42.839449 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f9b1f3ae-d395-494a-bf6a-e8fca9116c4d tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:42.839449 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f9b1f3ae-d395-494a-bf6a-e8fca9116c4d tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:43.005401 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-f9b1f3ae-d395-494a-bf6a-e8fca9116c4d tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:43.014886 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-f9b1f3ae-d395-494a-bf6a-e8fca9116c4d tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:43.015100 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-f9b1f3ae-d395-494a-bf6a-e8fca9116c4d tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:43.016925 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-f9b1f3ae-d395-494a-bf6a-e8fca9116c4d tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a" status: 200 len: 1731 microversion: 2.20 time: 0.190917 Jul 21 20:14:43.017477 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 465/911] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:14:42 2022] GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a => generated 1731 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 20:14:44.035515 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-593e7acf-60f8-42b1-b3c9-ab36b2b74ba1 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:14:44.036087 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-593e7acf-60f8-42b1-b3c9-ab36b2b74ba1 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: 5610f3fc-4e8b-48c0-a628-4b5c9419635a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:14:44.042425 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-593e7acf-60f8-42b1-b3c9-ab36b2b74ba1 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:44.042877 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-593e7acf-60f8-42b1-b3c9-ab36b2b74ba1 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:44.043721 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-593e7acf-60f8-42b1-b3c9-ab36b2b74ba1 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:44.044161 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-593e7acf-60f8-42b1-b3c9-ab36b2b74ba1 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:44.497283 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-593e7acf-60f8-42b1-b3c9-ab36b2b74ba1 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:44.506646 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-593e7acf-60f8-42b1-b3c9-ab36b2b74ba1 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:44.508523 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-593e7acf-60f8-42b1-b3c9-ab36b2b74ba1 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:44.509819 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-593e7acf-60f8-42b1-b3c9-ab36b2b74ba1 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a" status: 200 len: 1731 microversion: 2.20 time: 0.478385 Jul 21 20:14:44.510846 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 447/912] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:14:44 2022] GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a => generated 1731 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:14:45.631868 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-4397bce9-081c-4bf7-b031-a2def6ab2292 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:14:45.631868 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-4397bce9-081c-4bf7-b031-a2def6ab2292 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: 5610f3fc-4e8b-48c0-a628-4b5c9419635a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:14:45.631868 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4397bce9-081c-4bf7-b031-a2def6ab2292 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:45.631868 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4397bce9-081c-4bf7-b031-a2def6ab2292 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:45.634059 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4397bce9-081c-4bf7-b031-a2def6ab2292 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:45.634059 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4397bce9-081c-4bf7-b031-a2def6ab2292 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:45.744251 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-4397bce9-081c-4bf7-b031-a2def6ab2292 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:45.752806 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-4397bce9-081c-4bf7-b031-a2def6ab2292 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:45.754302 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-4397bce9-081c-4bf7-b031-a2def6ab2292 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:45.755515 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-4397bce9-081c-4bf7-b031-a2def6ab2292 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a" status: 200 len: 1731 microversion: 2.20 time: 0.231155 Jul 21 20:14:45.756086 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 466/913] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:14:45 2022] GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a => generated 1731 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:14:46.774144 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-a139398e-35cb-4b6a-a3ce-d576fe47e1bd tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:14:46.775040 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-a139398e-35cb-4b6a-a3ce-d576fe47e1bd tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: 5610f3fc-4e8b-48c0-a628-4b5c9419635a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:14:46.793850 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-a139398e-35cb-4b6a-a3ce-d576fe47e1bd tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:46.793850 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-a139398e-35cb-4b6a-a3ce-d576fe47e1bd tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:46.793850 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-a139398e-35cb-4b6a-a3ce-d576fe47e1bd tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:46.793850 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-a139398e-35cb-4b6a-a3ce-d576fe47e1bd tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:47.054978 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-a139398e-35cb-4b6a-a3ce-d576fe47e1bd tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:47.064102 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-a139398e-35cb-4b6a-a3ce-d576fe47e1bd tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:47.065874 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-a139398e-35cb-4b6a-a3ce-d576fe47e1bd tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:47.067315 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-a139398e-35cb-4b6a-a3ce-d576fe47e1bd tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a" status: 200 len: 1731 microversion: 2.20 time: 0.296992 Jul 21 20:14:47.067948 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 448/914] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:14:46 2022] GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a => generated 1731 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:14:48.086179 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-f06450cd-4444-4fae-90fe-3d1e1d25dced tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:14:48.086929 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-f06450cd-4444-4fae-90fe-3d1e1d25dced tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: 5610f3fc-4e8b-48c0-a628-4b5c9419635a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:14:48.101599 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f06450cd-4444-4fae-90fe-3d1e1d25dced tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:48.103441 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f06450cd-4444-4fae-90fe-3d1e1d25dced tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:48.104677 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f06450cd-4444-4fae-90fe-3d1e1d25dced tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:48.107529 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f06450cd-4444-4fae-90fe-3d1e1d25dced tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:48.650228 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-f06450cd-4444-4fae-90fe-3d1e1d25dced tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:48.661136 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-f06450cd-4444-4fae-90fe-3d1e1d25dced tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:48.664054 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-f06450cd-4444-4fae-90fe-3d1e1d25dced tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:48.665463 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-f06450cd-4444-4fae-90fe-3d1e1d25dced tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a" status: 200 len: 1731 microversion: 2.20 time: 0.583668 Jul 21 20:14:48.666355 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 467/915] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:14:48 2022] GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a => generated 1731 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:14:49.684865 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-95e0c068-ad4f-47ff-8f03-f6a5f7e8a6d8 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:14:49.687199 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-95e0c068-ad4f-47ff-8f03-f6a5f7e8a6d8 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: 5610f3fc-4e8b-48c0-a628-4b5c9419635a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:14:49.698874 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-95e0c068-ad4f-47ff-8f03-f6a5f7e8a6d8 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:49.699938 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-95e0c068-ad4f-47ff-8f03-f6a5f7e8a6d8 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:49.701009 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-95e0c068-ad4f-47ff-8f03-f6a5f7e8a6d8 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:49.701596 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-95e0c068-ad4f-47ff-8f03-f6a5f7e8a6d8 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:49.957249 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [req-c16d92f1-eedd-40be-8661-f846d952b2d1 req-58ebc21a-ed8a-4618-99f4-ebcc6667d5c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5610f3fc-4e8b-48c0-a628-4b5c9419635a", "name": "network-vif-plugged", "status": "completed", "tag": "c9b7a4f8-5df1-449c-9157-130a564accea"}]} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:14:49.975335 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-c16d92f1-eedd-40be-8661-f846d952b2d1 req-58ebc21a-ed8a-4618-99f4-ebcc6667d5c7 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:49.977843 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-c16d92f1-eedd-40be-8661-f846d952b2d1 req-58ebc21a-ed8a-4618-99f4-ebcc6667d5c7 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:49.980762 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:14:50.003277 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.compute.server_external_events [req-c16d92f1-eedd-40be-8661-f846d952b2d1 req-58ebc21a-ed8a-4618-99f4-ebcc6667d5c7 service nova] Creating event network-vif-plugged:c9b7a4f8-5df1-449c-9157-130a564accea for instance 5610f3fc-4e8b-48c0-a628-4b5c9419635a on hv-cinder-85054 Jul 21 20:14:50.009074 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [req-c16d92f1-eedd-40be-8661-f846d952b2d1 req-58ebc21a-ed8a-4618-99f4-ebcc6667d5c7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056763 Jul 21 20:14:50.010209 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 468/916] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 20:14:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:14:50.275807 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-95e0c068-ad4f-47ff-8f03-f6a5f7e8a6d8 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:50.286072 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-95e0c068-ad4f-47ff-8f03-f6a5f7e8a6d8 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:50.288107 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-95e0c068-ad4f-47ff-8f03-f6a5f7e8a6d8 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:50.290226 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-95e0c068-ad4f-47ff-8f03-f6a5f7e8a6d8 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a" status: 200 len: 1731 microversion: 2.20 time: 0.610243 Jul 21 20:14:50.291496 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 449/917] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:14:49 2022] GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a => generated 1731 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:14:50.297279 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-fe732614-1b21-44e1-8574-0c3cd5fd239f tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:14:50.297279 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-fe732614-1b21-44e1-8574-0c3cd5fd239f tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: dff45473-c8cb-40c9-8cbb-bc98056c340a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:14:50.305694 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-fe732614-1b21-44e1-8574-0c3cd5fd239f tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:50.306771 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-fe732614-1b21-44e1-8574-0c3cd5fd239f tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:50.307911 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-fe732614-1b21-44e1-8574-0c3cd5fd239f tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:50.308619 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-fe732614-1b21-44e1-8574-0c3cd5fd239f tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:50.333115 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-fe732614-1b21-44e1-8574-0c3cd5fd239f tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/dff45473-c8cb-40c9-8cbb-bc98056c340a/ips" status: 200 len: 144 microversion: 2.1 time: 0.040140 Jul 21 20:14:50.351409 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 450/918] 10.222.0.58 () {58 vars in 1247 bytes} [Thu Jul 21 20:14:50 2022] GET /compute/v2.1/servers/dff45473-c8cb-40c9-8cbb-bc98056c340a/ips => generated 144 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:14:50.419360 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-57025b39-f024-49da-8065-356912e9b614 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Action: 'create', calling method: .version_select at 0x7f351cdf75e0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1032901572", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEffS2glH6dxw8hA+E9+qqyn//Xn2nDi+zUTZmS9P0Sn4ufbOpUi3COZ9sOFOW3GndokpbD7i9Wvz4ggOPJ/tCL0xTsXK6m/bLRWwId8E6VAjDQy8VTAM6M9/djS5dKJQw=="}} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:14:50.435532 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.quota [None req-57025b39-f024-49da-8065-356912e9b614 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Getting quotas for project 997a259cf4b240fba9b065a43b2ed4fc. Resources: {'key_pairs'} {{(pid=118345) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 20:14:50.441551 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.quota [None req-57025b39-f024-49da-8065-356912e9b614 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Getting quotas for user c4460571d9294e38931274a55c6c5857 and project 997a259cf4b240fba9b065a43b2ed4fc. Resources: {'key_pairs'} {{(pid=118345) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 20:14:50.576622 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-57025b39-f024-49da-8065-356912e9b614 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.565031 Jul 21 20:14:50.577236 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 469/919] 10.222.0.58 () {60 vars in 1158 bytes} [Thu Jul 21 20:14:50 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:14:51.308552 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-bca294a9-9f70-4d1d-8757-ce8087824765 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:14:51.309311 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-bca294a9-9f70-4d1d-8757-ce8087824765 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: 5610f3fc-4e8b-48c0-a628-4b5c9419635a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:14:51.316402 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-bca294a9-9f70-4d1d-8757-ce8087824765 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:51.316849 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-bca294a9-9f70-4d1d-8757-ce8087824765 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:51.317618 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-bca294a9-9f70-4d1d-8757-ce8087824765 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:51.318050 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-bca294a9-9f70-4d1d-8757-ce8087824765 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:51.464052 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-bca294a9-9f70-4d1d-8757-ce8087824765 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:51.468631 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-bca294a9-9f70-4d1d-8757-ce8087824765 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:51.470151 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-bca294a9-9f70-4d1d-8757-ce8087824765 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:51.471594 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-bca294a9-9f70-4d1d-8757-ce8087824765 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a" status: 200 len: 1731 microversion: 2.20 time: 0.166877 Jul 21 20:14:51.472148 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 451/920] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:14:51 2022] GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a => generated 1731 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 20:14:52.491272 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-2dc68bc7-6a07-4a5d-bdc4-052591b15221 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:14:52.492049 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-2dc68bc7-6a07-4a5d-bdc4-052591b15221 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: 5610f3fc-4e8b-48c0-a628-4b5c9419635a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:14:52.499087 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2dc68bc7-6a07-4a5d-bdc4-052591b15221 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:52.499570 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2dc68bc7-6a07-4a5d-bdc4-052591b15221 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:52.500402 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2dc68bc7-6a07-4a5d-bdc4-052591b15221 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:52.500838 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2dc68bc7-6a07-4a5d-bdc4-052591b15221 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:52.713000 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-2dc68bc7-6a07-4a5d-bdc4-052591b15221 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:52.737482 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-2dc68bc7-6a07-4a5d-bdc4-052591b15221 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:52.737482 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-2dc68bc7-6a07-4a5d-bdc4-052591b15221 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:52.737482 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-2dc68bc7-6a07-4a5d-bdc4-052591b15221 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a" status: 200 len: 1731 microversion: 2.20 time: 0.243719 Jul 21 20:14:52.737906 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 470/921] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:14:52 2022] GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a => generated 1731 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:14:53.148690 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-fd300129-bf3e-4861-864e-d4f4a32293b5 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1912b855-cbac-4820-88a5-b42bd671b7c0"}} {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:14:53.149745 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-fd300129-bf3e-4861-864e-d4f4a32293b5 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: dff45473-c8cb-40c9-8cbb-bc98056c340a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:14:53.157005 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-fd300129-bf3e-4861-864e-d4f4a32293b5 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:53.157486 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-fd300129-bf3e-4861-864e-d4f4a32293b5 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:53.158257 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-fd300129-bf3e-4861-864e-d4f4a32293b5 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:53.158693 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-fd300129-bf3e-4861-864e-d4f4a32293b5 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:53.176335 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG dbcounter [-] [118344] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=118344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:14:53.748038 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-a8da7fce-2b97-40e9-8401-39c5917b657c tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:14:53.748603 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-a8da7fce-2b97-40e9-8401-39c5917b657c tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: 5610f3fc-4e8b-48c0-a628-4b5c9419635a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:14:53.755738 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a8da7fce-2b97-40e9-8401-39c5917b657c tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:53.756456 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a8da7fce-2b97-40e9-8401-39c5917b657c tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:53.757236 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a8da7fce-2b97-40e9-8401-39c5917b657c tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:53.757680 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a8da7fce-2b97-40e9-8401-39c5917b657c tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:53.903484 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-a8da7fce-2b97-40e9-8401-39c5917b657c tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:53.912062 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-a8da7fce-2b97-40e9-8401-39c5917b657c tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:53.913582 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-a8da7fce-2b97-40e9-8401-39c5917b657c tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:53.914974 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-a8da7fce-2b97-40e9-8401-39c5917b657c tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a" status: 200 len: 1731 microversion: 2.20 time: 0.171221 Jul 21 20:14:53.915574 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 471/922] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:14:53 2022] GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a => generated 1731 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:14:54.139352 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-fd300129-bf3e-4861-864e-d4f4a32293b5 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "POST /compute/v2.1/servers/dff45473-c8cb-40c9-8cbb-bc98056c340a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.994683 Jul 21 20:14:54.141033 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 452/923] 10.222.0.58 () {60 vars in 1322 bytes} [Thu Jul 21 20:14:53 2022] POST /compute/v2.1/servers/dff45473-c8cb-40c9-8cbb-bc98056c340a/os-volume_attachments => generated 194 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:14:55.144423 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-7615a523-c82b-4d4d-a377-411ac817c778 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:14:55.145032 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-7615a523-c82b-4d4d-a377-411ac817c778 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: 5610f3fc-4e8b-48c0-a628-4b5c9419635a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:14:55.151959 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-7615a523-c82b-4d4d-a377-411ac817c778 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:55.152403 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-7615a523-c82b-4d4d-a377-411ac817c778 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:55.153176 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-7615a523-c82b-4d4d-a377-411ac817c778 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:14:55.153605 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-7615a523-c82b-4d4d-a377-411ac817c778 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:14:55.296787 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-7615a523-c82b-4d4d-a377-411ac817c778 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:55.306149 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-7615a523-c82b-4d4d-a377-411ac817c778 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:55.307747 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-7615a523-c82b-4d4d-a377-411ac817c778 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:14:55.309107 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-7615a523-c82b-4d4d-a377-411ac817c778 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a" status: 200 len: 1718 microversion: 2.20 time: 0.379439 Jul 21 20:14:55.309843 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 472/924] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:14:54 2022] GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a => generated 1718 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:15:00.248825 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 20:15:00.254678 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Thu Jul 21 20:15:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 20:15:02.797035 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-f48bc3e5-0c7f-4fd0-8995-606827d5e27e tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:15:02.798131 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-f48bc3e5-0c7f-4fd0-8995-606827d5e27e tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: dff45473-c8cb-40c9-8cbb-bc98056c340a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:15:02.804668 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f48bc3e5-0c7f-4fd0-8995-606827d5e27e tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:15:02.805122 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f48bc3e5-0c7f-4fd0-8995-606827d5e27e tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:15:02.805919 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f48bc3e5-0c7f-4fd0-8995-606827d5e27e tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:15:02.806360 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f48bc3e5-0c7f-4fd0-8995-606827d5e27e tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:15:02.850696 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-f48bc3e5-0c7f-4fd0-8995-606827d5e27e tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/dff45473-c8cb-40c9-8cbb-bc98056c340a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058564 Jul 21 20:15:02.851301 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 453/925] 10.222.0.58 () {58 vars in 1301 bytes} [Thu Jul 21 20:15:02 2022] GET /compute/v2.1/servers/dff45473-c8cb-40c9-8cbb-bc98056c340a/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 20:15:02.861659 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-733236b9-b14c-4a62-9609-8de88401ad88 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:15:02.862392 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-733236b9-b14c-4a62-9609-8de88401ad88 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: dff45473-c8cb-40c9-8cbb-bc98056c340a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:15:02.866435 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell0:SELECT=4 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:15:02.870443 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-733236b9-b14c-4a62-9609-8de88401ad88 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:15:02.870885 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-733236b9-b14c-4a62-9609-8de88401ad88 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:15:02.871687 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-733236b9-b14c-4a62-9609-8de88401ad88 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:15:02.872118 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-733236b9-b14c-4a62-9609-8de88401ad88 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:15:02.902148 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-733236b9-b14c-4a62-9609-8de88401ad88 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/dff45473-c8cb-40c9-8cbb-bc98056c340a/os-volume_attachments/1912b855-cbac-4820-88a5-b42bd671b7c0" status: 200 len: 194 microversion: 2.1 time: 0.044772 Jul 21 20:15:02.902997 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 473/926] 10.222.0.58 () {58 vars in 1412 bytes} [Thu Jul 21 20:15:02 2022] GET /compute/v2.1/servers/dff45473-c8cb-40c9-8cbb-bc98056c340a/os-volume_attachments/1912b855-cbac-4820-88a5-b42bd671b7c0 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:15:05.641258 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-19460e0c-5f78-4d88-945f-c060bd985e0f tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e30b4944-71f4-4906-8549-25349cc43eee"}} {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:15:05.642450 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-19460e0c-5f78-4d88-945f-c060bd985e0f tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: dff45473-c8cb-40c9-8cbb-bc98056c340a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:15:05.649860 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-19460e0c-5f78-4d88-945f-c060bd985e0f tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:15:05.650549 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-19460e0c-5f78-4d88-945f-c060bd985e0f tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:15:05.651378 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-19460e0c-5f78-4d88-945f-c060bd985e0f tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:15:05.651815 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-19460e0c-5f78-4d88-945f-c060bd985e0f tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:15:06.412712 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-19460e0c-5f78-4d88-945f-c060bd985e0f tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "POST /compute/v2.1/servers/dff45473-c8cb-40c9-8cbb-bc98056c340a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.775179 Jul 21 20:15:06.414687 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 454/927] 10.222.0.58 () {60 vars in 1322 bytes} [Thu Jul 21 20:15:05 2022] POST /compute/v2.1/servers/dff45473-c8cb-40c9-8cbb-bc98056c340a/os-volume_attachments => generated 194 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:15:16.006051 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-361246ae-d062-4b07-8bcc-eceb102005be tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:15:16.006962 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-361246ae-d062-4b07-8bcc-eceb102005be tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: dff45473-c8cb-40c9-8cbb-bc98056c340a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:15:16.008848 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:15:16.009486 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell1:SELECT=25 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:15:16.014289 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-361246ae-d062-4b07-8bcc-eceb102005be tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:15:16.014746 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-361246ae-d062-4b07-8bcc-eceb102005be tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:15:16.015530 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-361246ae-d062-4b07-8bcc-eceb102005be tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:15:16.015993 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-361246ae-d062-4b07-8bcc-eceb102005be tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:15:16.046042 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-361246ae-d062-4b07-8bcc-eceb102005be tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/dff45473-c8cb-40c9-8cbb-bc98056c340a/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044339 Jul 21 20:15:16.046591 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 474/928] 10.222.0.58 () {58 vars in 1301 bytes} [Thu Jul 21 20:15:16 2022] GET /compute/v2.1/servers/dff45473-c8cb-40c9-8cbb-bc98056c340a/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:15:16.184165 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG dbcounter [-] [118344] Writing DB stats nova_api:SELECT=19 {{(pid=118344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:15:16.188509 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-5b5a4f40-1b89-4de1-a08c-42220457bc7e tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:15:16.189082 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-5b5a4f40-1b89-4de1-a08c-42220457bc7e tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: dff45473-c8cb-40c9-8cbb-bc98056c340a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:15:16.195175 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-5b5a4f40-1b89-4de1-a08c-42220457bc7e tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:15:16.219519 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-5b5a4f40-1b89-4de1-a08c-42220457bc7e tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:15:16.219519 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-5b5a4f40-1b89-4de1-a08c-42220457bc7e tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:15:16.219519 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-5b5a4f40-1b89-4de1-a08c-42220457bc7e tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:15:16.224947 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-5b5a4f40-1b89-4de1-a08c-42220457bc7e tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/dff45473-c8cb-40c9-8cbb-bc98056c340a/os-volume_attachments/1912b855-cbac-4820-88a5-b42bd671b7c0" status: 200 len: 194 microversion: 2.1 time: 0.042306 Jul 21 20:15:16.225513 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 455/929] 10.222.0.58 () {58 vars in 1412 bytes} [Thu Jul 21 20:15:16 2022] GET /compute/v2.1/servers/dff45473-c8cb-40c9-8cbb-bc98056c340a/os-volume_attachments/1912b855-cbac-4820-88a5-b42bd671b7c0 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:15:16.236993 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-efa81fc7-33fc-4d10-abb2-519076eac3b1 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:15:16.237501 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-efa81fc7-33fc-4d10-abb2-519076eac3b1 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: dff45473-c8cb-40c9-8cbb-bc98056c340a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:15:16.244153 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-efa81fc7-33fc-4d10-abb2-519076eac3b1 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:15:16.244603 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-efa81fc7-33fc-4d10-abb2-519076eac3b1 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:15:16.245384 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-efa81fc7-33fc-4d10-abb2-519076eac3b1 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:15:16.246143 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-efa81fc7-33fc-4d10-abb2-519076eac3b1 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:15:16.326224 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.objects.instance [None req-efa81fc7-33fc-4d10-abb2-519076eac3b1 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lazy-loading 'services' on Instance uuid dff45473-c8cb-40c9-8cbb-bc98056c340a {{(pid=118345) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 20:15:16.561567 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-efa81fc7-33fc-4d10-abb2-519076eac3b1 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "DELETE /compute/v2.1/servers/dff45473-c8cb-40c9-8cbb-bc98056c340a/os-volume_attachments/1912b855-cbac-4820-88a5-b42bd671b7c0" status: 202 len: 0 microversion: 2.1 time: 0.329382 Jul 21 20:15:16.562371 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 475/930] 10.222.0.58 () {58 vars in 1415 bytes} [Thu Jul 21 20:15:16 2022] DELETE /compute/v2.1/servers/dff45473-c8cb-40c9-8cbb-bc98056c340a/os-volume_attachments/1912b855-cbac-4820-88a5-b42bd671b7c0 => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 20:15:18.729152 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-19c0ec53-68da-424e-adf7-456653794cee tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:15:18.729664 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-19c0ec53-68da-424e-adf7-456653794cee tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: dff45473-c8cb-40c9-8cbb-bc98056c340a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:15:18.736741 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-19c0ec53-68da-424e-adf7-456653794cee tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:15:18.737180 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-19c0ec53-68da-424e-adf7-456653794cee tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:15:18.738574 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-19c0ec53-68da-424e-adf7-456653794cee tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:15:18.739369 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-19c0ec53-68da-424e-adf7-456653794cee tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:15:18.769239 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-19c0ec53-68da-424e-adf7-456653794cee tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/dff45473-c8cb-40c9-8cbb-bc98056c340a/os-volume_attachments/e30b4944-71f4-4906-8549-25349cc43eee" status: 200 len: 194 microversion: 2.1 time: 0.044327 Jul 21 20:15:18.769811 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 456/931] 10.222.0.58 () {58 vars in 1412 bytes} [Thu Jul 21 20:15:18 2022] GET /compute/v2.1/servers/dff45473-c8cb-40c9-8cbb-bc98056c340a/os-volume_attachments/e30b4944-71f4-4906-8549-25349cc43eee => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:15:18.780177 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-8998dcc4-987c-4479-94db-ba9c7c0e600c tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:15:18.787796 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-8998dcc4-987c-4479-94db-ba9c7c0e600c tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: dff45473-c8cb-40c9-8cbb-bc98056c340a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:15:18.787796 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8998dcc4-987c-4479-94db-ba9c7c0e600c tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:15:18.787796 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8998dcc4-987c-4479-94db-ba9c7c0e600c tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:15:18.788230 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8998dcc4-987c-4479-94db-ba9c7c0e600c tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:15:18.788658 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8998dcc4-987c-4479-94db-ba9c7c0e600c tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:15:18.866740 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.objects.instance [None req-8998dcc4-987c-4479-94db-ba9c7c0e600c tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lazy-loading 'services' on Instance uuid dff45473-c8cb-40c9-8cbb-bc98056c340a {{(pid=118345) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 20:15:19.087451 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-8998dcc4-987c-4479-94db-ba9c7c0e600c tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "DELETE /compute/v2.1/servers/dff45473-c8cb-40c9-8cbb-bc98056c340a/os-volume_attachments/e30b4944-71f4-4906-8549-25349cc43eee" status: 202 len: 0 microversion: 2.1 time: 0.311461 Jul 21 20:15:19.088279 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 476/932] 10.222.0.58 () {58 vars in 1415 bytes} [Thu Jul 21 20:15:18 2022] DELETE /compute/v2.1/servers/dff45473-c8cb-40c9-8cbb-bc98056c340a/os-volume_attachments/e30b4944-71f4-4906-8549-25349cc43eee => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 20:15:21.209751 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-6e3fcb7e-4292-4391-a0d3-3d637cbea7ea tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-635987197", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1032901572", "security_groups": [{"name": "tempest-secgroup-smoke-1994785573"}], "block_device_mapping_v2": [{"uuid": "263a01fb-c70f-40eb-8320-e4cc3c6140f4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6458e3c6-6a10-4dd1-8440-3ff5b4539889"}]}} {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:15:21.295388 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-550bb97a-bd44-4275-b9a8-6d8024390d87 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:15:21.296488 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-550bb97a-bd44-4275-b9a8-6d8024390d87 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: dff45473-c8cb-40c9-8cbb-bc98056c340a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:15:21.302741 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-550bb97a-bd44-4275-b9a8-6d8024390d87 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:15:21.303216 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-550bb97a-bd44-4275-b9a8-6d8024390d87 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:15:21.303988 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-550bb97a-bd44-4275-b9a8-6d8024390d87 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:15:21.304421 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-550bb97a-bd44-4275-b9a8-6d8024390d87 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:15:21.323836 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.network.neutron [None req-6e3fcb7e-4292-4391-a0d3-3d637cbea7ea tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] validate_networks() for [('6458e3c6-6a10-4dd1-8440-3ff5b4539889', None, None, None, None, None)] {{(pid=118344) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 20:15:21.333766 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-550bb97a-bd44-4275-b9a8-6d8024390d87 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/dff45473-c8cb-40c9-8cbb-bc98056c340a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042842 Jul 21 20:15:21.334329 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 477/933] 10.222.0.58 () {58 vars in 1301 bytes} [Thu Jul 21 20:15:21 2022] GET /compute/v2.1/servers/dff45473-c8cb-40c9-8cbb-bc98056c340a/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 21 20:15:21.438456 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-d7a1dd8a-1bb3-4859-9dac-223974b52e81 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:15:21.439482 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-d7a1dd8a-1bb3-4859-9dac-223974b52e81 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: dff45473-c8cb-40c9-8cbb-bc98056c340a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:15:21.446455 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d7a1dd8a-1bb3-4859-9dac-223974b52e81 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:15:21.446903 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d7a1dd8a-1bb3-4859-9dac-223974b52e81 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:15:21.447697 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d7a1dd8a-1bb3-4859-9dac-223974b52e81 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:15:21.448131 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d7a1dd8a-1bb3-4859-9dac-223974b52e81 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:15:21.477836 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-d7a1dd8a-1bb3-4859-9dac-223974b52e81 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/dff45473-c8cb-40c9-8cbb-bc98056c340a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043133 Jul 21 20:15:21.478318 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 478/934] 10.222.0.58 () {58 vars in 1301 bytes} [Thu Jul 21 20:15:21 2022] GET /compute/v2.1/servers/dff45473-c8cb-40c9-8cbb-bc98056c340a/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 21 20:15:21.535811 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-40cfe6f2-76d0-4120-85e0-3f0eaca81bc4 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:15:21.536307 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-40cfe6f2-76d0-4120-85e0-3f0eaca81bc4 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: dff45473-c8cb-40c9-8cbb-bc98056c340a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:15:21.542233 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-40cfe6f2-76d0-4120-85e0-3f0eaca81bc4 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:15:21.542682 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-40cfe6f2-76d0-4120-85e0-3f0eaca81bc4 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:15:21.543477 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-40cfe6f2-76d0-4120-85e0-3f0eaca81bc4 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:15:21.543915 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-40cfe6f2-76d0-4120-85e0-3f0eaca81bc4 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:15:21.569293 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-40cfe6f2-76d0-4120-85e0-3f0eaca81bc4 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: dff45473-c8cb-40c9-8cbb-bc98056c340a] Going to try to terminate instance {{(pid=118345) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 20:15:21.712747 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.virt.hardware [None req-6e3fcb7e-4292-4391-a0d3-3d637cbea7ea tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Flavor limits 0:0:0 {{(pid=118344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 20:15:21.713164 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.virt.hardware [None req-6e3fcb7e-4292-4391-a0d3-3d637cbea7ea tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Image limits 0:0:0 {{(pid=118344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 20:15:21.717476 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.virt.hardware [None req-6e3fcb7e-4292-4391-a0d3-3d637cbea7ea tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Flavor pref 0:0:0 {{(pid=118344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 20:15:21.717476 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.virt.hardware [None req-6e3fcb7e-4292-4391-a0d3-3d637cbea7ea tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Image pref 0:0:0 {{(pid=118344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 20:15:21.717476 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.virt.hardware [None req-6e3fcb7e-4292-4391-a0d3-3d637cbea7ea tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 20:15:21.723441 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-6e3fcb7e-4292-4391-a0d3-3d637cbea7ea tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:15:21.723884 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-6e3fcb7e-4292-4391-a0d3-3d637cbea7ea tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:15:21.724683 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-6e3fcb7e-4292-4391-a0d3-3d637cbea7ea tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:15:21.725115 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-6e3fcb7e-4292-4391-a0d3-3d637cbea7ea tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:15:21.741824 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.quota [None req-6e3fcb7e-4292-4391-a0d3-3d637cbea7ea tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Getting quotas for project 997a259cf4b240fba9b065a43b2ed4fc. Resources: {'instances', 'cores', 'ram'} {{(pid=118344) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 20:15:21.745670 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.quota [None req-6e3fcb7e-4292-4391-a0d3-3d637cbea7ea tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Getting quotas for user c4460571d9294e38931274a55c6c5857 and project 997a259cf4b240fba9b065a43b2ed4fc. Resources: {'instances', 'cores', 'ram'} {{(pid=118344) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 20:15:21.803493 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-6e3fcb7e-4292-4391-a0d3-3d637cbea7ea tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Going to run 1 instances... {{(pid=118344) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 20:15:21.805542 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-6e3fcb7e-4292-4391-a0d3-3d637cbea7ea tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] [instance: 80714390-c8b6-4703-a02a-d41fafad3540] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='263a01fb-c70f-40eb-8320-e4cc3c6140f4',volume_size=None,volume_type=None)] {{(pid=118344) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 20:15:21.848735 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-40cfe6f2-76d0-4120-85e0-3f0eaca81bc4 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "DELETE /compute/v2.1/servers/dff45473-c8cb-40c9-8cbb-bc98056c340a" status: 204 len: 0 microversion: 2.1 time: 0.316501 Jul 21 20:15:21.849341 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 479/935] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Jul 21 20:15:21 2022] DELETE /compute/v2.1/servers/dff45473-c8cb-40c9-8cbb-bc98056c340a => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 21 20:15:21.857764 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-44aaeda6-acea-40d8-a2fc-423ec5c64ce3 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:15:21.858459 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-44aaeda6-acea-40d8-a2fc-423ec5c64ce3 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: dff45473-c8cb-40c9-8cbb-bc98056c340a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:15:21.864942 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-44aaeda6-acea-40d8-a2fc-423ec5c64ce3 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:15:21.865391 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-44aaeda6-acea-40d8-a2fc-423ec5c64ce3 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:15:21.866151 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-44aaeda6-acea-40d8-a2fc-423ec5c64ce3 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:15:21.866585 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-44aaeda6-acea-40d8-a2fc-423ec5c64ce3 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:15:22.010475 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-44aaeda6-acea-40d8-a2fc-423ec5c64ce3 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:15:22.018116 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-44aaeda6-acea-40d8-a2fc-423ec5c64ce3 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/dff45473-c8cb-40c9-8cbb-bc98056c340a" status: 200 len: 1673 microversion: 2.1 time: 0.164450 Jul 21 20:15:22.018707 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 480/936] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:15:21 2022] GET /compute/v2.1/servers/dff45473-c8cb-40c9-8cbb-bc98056c340a => generated 1673 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:15:22.215252 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-6e3fcb7e-4292-4391-a0d3-3d637cbea7ea tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.010000 Jul 21 20:15:22.215887 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 457/937] 10.222.0.58 () {60 vars in 1146 bytes} [Thu Jul 21 20:15:21 2022] POST /compute/v2.1/servers => generated 406 bytes in 1011 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 20:15:22.226545 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-7994c723-48d1-47a2-a314-26ecb68c18fa tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:15:22.227175 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-7994c723-48d1-47a2-a314-26ecb68c18fa tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] [instance: 80714390-c8b6-4703-a02a-d41fafad3540] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:15:22.283710 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-7994c723-48d1-47a2-a314-26ecb68c18fa tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4460571d9294e38931274a55c6c5857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a259cf4b240fba9b065a43b2ed4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:15:22.293366 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-7994c723-48d1-47a2-a314-26ecb68c18fa tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] 10.222.0.58 "GET /compute/v2.1/servers/80714390-c8b6-4703-a02a-d41fafad3540" status: 200 len: 1094 microversion: 2.1 time: 0.070583 Jul 21 20:15:22.294336 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 481/938] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:15:22 2022] GET /compute/v2.1/servers/80714390-c8b6-4703-a02a-d41fafad3540 => generated 1094 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:15:23.035814 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-b3ba7c8e-1b02-451a-9835-985fc98f75e1 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:15:23.036372 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-b3ba7c8e-1b02-451a-9835-985fc98f75e1 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: dff45473-c8cb-40c9-8cbb-bc98056c340a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:15:23.043202 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-b3ba7c8e-1b02-451a-9835-985fc98f75e1 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:15:23.043656 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-b3ba7c8e-1b02-451a-9835-985fc98f75e1 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:15:23.044429 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-b3ba7c8e-1b02-451a-9835-985fc98f75e1 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:15:23.044867 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-b3ba7c8e-1b02-451a-9835-985fc98f75e1 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:15:23.172823 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-b3ba7c8e-1b02-451a-9835-985fc98f75e1 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:15:23.180872 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-b3ba7c8e-1b02-451a-9835-985fc98f75e1 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/dff45473-c8cb-40c9-8cbb-bc98056c340a" status: 200 len: 1673 microversion: 2.1 time: 0.149529 Jul 21 20:15:23.182426 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 458/939] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:15:23 2022] GET /compute/v2.1/servers/dff45473-c8cb-40c9-8cbb-bc98056c340a => generated 1673 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:15:23.310077 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-4b9288d6-af16-4227-af23-c4eeb568ae16 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:15:23.310601 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-4b9288d6-af16-4227-af23-c4eeb568ae16 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] [instance: 80714390-c8b6-4703-a02a-d41fafad3540] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:15:23.317470 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4b9288d6-af16-4227-af23-c4eeb568ae16 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:15:23.317919 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4b9288d6-af16-4227-af23-c4eeb568ae16 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:15:23.318686 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4b9288d6-af16-4227-af23-c4eeb568ae16 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:15:23.321922 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4b9288d6-af16-4227-af23-c4eeb568ae16 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:15:23.380210 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-4b9288d6-af16-4227-af23-c4eeb568ae16 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4460571d9294e38931274a55c6c5857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a259cf4b240fba9b065a43b2ed4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:15:23.387595 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-4b9288d6-af16-4227-af23-c4eeb568ae16 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] 10.222.0.58 "GET /compute/v2.1/servers/80714390-c8b6-4703-a02a-d41fafad3540" status: 200 len: 1144 microversion: 2.1 time: 0.081735 Jul 21 20:15:23.388196 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 482/940] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:15:23 2022] GET /compute/v2.1/servers/80714390-c8b6-4703-a02a-d41fafad3540 => generated 1144 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:15:24.198440 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-5a95d56b-9109-47f7-bc6e-165ac13df005 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:15:24.199235 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-5a95d56b-9109-47f7-bc6e-165ac13df005 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: dff45473-c8cb-40c9-8cbb-bc98056c340a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:15:24.206236 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-5a95d56b-9109-47f7-bc6e-165ac13df005 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:15:24.207556 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-5a95d56b-9109-47f7-bc6e-165ac13df005 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:15:24.208497 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-5a95d56b-9109-47f7-bc6e-165ac13df005 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:15:24.209237 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-5a95d56b-9109-47f7-bc6e-165ac13df005 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:15:24.213779 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG dbcounter [-] [118344] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:15:24.404705 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-579d09c2-d2f6-440b-a37a-448366ffb439 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:15:24.405589 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-579d09c2-d2f6-440b-a37a-448366ffb439 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] [instance: 80714390-c8b6-4703-a02a-d41fafad3540] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:15:24.413241 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-579d09c2-d2f6-440b-a37a-448366ffb439 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:15:24.413695 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-579d09c2-d2f6-440b-a37a-448366ffb439 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:15:24.414524 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-579d09c2-d2f6-440b-a37a-448366ffb439 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:15:24.415311 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-579d09c2-d2f6-440b-a37a-448366ffb439 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:15:24.420534 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-5a95d56b-9109-47f7-bc6e-165ac13df005 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:15:24.429909 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-5a95d56b-9109-47f7-bc6e-165ac13df005 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/dff45473-c8cb-40c9-8cbb-bc98056c340a" status: 200 len: 1673 microversion: 2.1 time: 0.234666 Jul 21 20:15:24.430799 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 459/941] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:15:24 2022] GET /compute/v2.1/servers/dff45473-c8cb-40c9-8cbb-bc98056c340a => generated 1673 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:15:24.486520 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-579d09c2-d2f6-440b-a37a-448366ffb439 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4460571d9294e38931274a55c6c5857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a259cf4b240fba9b065a43b2ed4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:15:24.494737 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-579d09c2-d2f6-440b-a37a-448366ffb439 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] 10.222.0.58 "GET /compute/v2.1/servers/80714390-c8b6-4703-a02a-d41fafad3540" status: 200 len: 1192 microversion: 2.1 time: 0.094004 Jul 21 20:15:24.495502 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 483/942] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:15:24 2022] GET /compute/v2.1/servers/80714390-c8b6-4703-a02a-d41fafad3540 => generated 1192 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:15:24.958682 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [req-07b65caa-1e39-4a01-8a7f-83ee6b3d559a req-7005752b-f165-423b-af3e-5faaa6155a2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dff45473-c8cb-40c9-8cbb-bc98056c340a", "name": "network-vif-deleted", "tag": "90b14516-2737-470e-87c1-cc22ffa351fc"}]} {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:15:24.970403 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [req-07b65caa-1e39-4a01-8a7f-83ee6b3d559a req-7005752b-f165-423b-af3e-5faaa6155a2c service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:15:24.971552 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [req-07b65caa-1e39-4a01-8a7f-83ee6b3d559a req-7005752b-f165-423b-af3e-5faaa6155a2c service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:15:24.990030 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.compute.server_external_events [req-07b65caa-1e39-4a01-8a7f-83ee6b3d559a req-7005752b-f165-423b-af3e-5faaa6155a2c service nova] Creating event network-vif-deleted:90b14516-2737-470e-87c1-cc22ffa351fc for instance dff45473-c8cb-40c9-8cbb-bc98056c340a on hv-cinder-85054 Jul 21 20:15:24.998240 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [req-07b65caa-1e39-4a01-8a7f-83ee6b3d559a req-7005752b-f165-423b-af3e-5faaa6155a2c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043251 Jul 21 20:15:25.000012 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 460/943] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 20:15:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:15:25.451833 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-46878325-b39a-439a-86a9-099c289a23ad tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:15:25.451833 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-46878325-b39a-439a-86a9-099c289a23ad tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: dff45473-c8cb-40c9-8cbb-bc98056c340a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:15:25.462319 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-46878325-b39a-439a-86a9-099c289a23ad tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:15:25.463740 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-46878325-b39a-439a-86a9-099c289a23ad tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:15:25.465768 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-46878325-b39a-439a-86a9-099c289a23ad tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:15:25.466932 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-46878325-b39a-439a-86a9-099c289a23ad tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:15:25.506628 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-46878325-b39a-439a-86a9-099c289a23ad tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:15:25.507370 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-46878325-b39a-439a-86a9-099c289a23ad tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:15:25.511528 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.objects.instance [None req-46878325-b39a-439a-86a9-099c289a23ad tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lazy-loading 'fault' on Instance uuid dff45473-c8cb-40c9-8cbb-bc98056c340a {{(pid=118345) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 20:15:25.513913 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-f88cf0ec-2c02-4e0f-8b24-a504ce884242 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:15:25.514653 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-f88cf0ec-2c02-4e0f-8b24-a504ce884242 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] [instance: 80714390-c8b6-4703-a02a-d41fafad3540] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:15:25.526487 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f88cf0ec-2c02-4e0f-8b24-a504ce884242 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:15:25.532025 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f88cf0ec-2c02-4e0f-8b24-a504ce884242 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:15:25.541653 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f88cf0ec-2c02-4e0f-8b24-a504ce884242 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:15:25.541653 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f88cf0ec-2c02-4e0f-8b24-a504ce884242 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:15:25.574548 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-46878325-b39a-439a-86a9-099c289a23ad tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f668466fa542039e88b4fc7714de81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e462e9247c4feab7e498186a547728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:15:25.583585 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-46878325-b39a-439a-86a9-099c289a23ad tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/dff45473-c8cb-40c9-8cbb-bc98056c340a" status: 200 len: 1328 microversion: 2.1 time: 0.139926 Jul 21 20:15:25.585189 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 484/944] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:15:25 2022] GET /compute/v2.1/servers/dff45473-c8cb-40c9-8cbb-bc98056c340a => generated 1328 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:15:25.658663 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-f88cf0ec-2c02-4e0f-8b24-a504ce884242 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4460571d9294e38931274a55c6c5857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a259cf4b240fba9b065a43b2ed4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:15:25.664037 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-f88cf0ec-2c02-4e0f-8b24-a504ce884242 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] 10.222.0.58 "GET /compute/v2.1/servers/80714390-c8b6-4703-a02a-d41fafad3540" status: 200 len: 1210 microversion: 2.1 time: 0.154991 Jul 21 20:15:25.664730 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 461/945] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:15:25 2022] GET /compute/v2.1/servers/80714390-c8b6-4703-a02a-d41fafad3540 => generated 1210 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:15:26.601458 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-52c8e6ba-f4ec-43a6-b37a-b90d939849b3 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:15:26.602139 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-52c8e6ba-f4ec-43a6-b37a-b90d939849b3 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: dff45473-c8cb-40c9-8cbb-bc98056c340a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:15:26.608239 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-52c8e6ba-f4ec-43a6-b37a-b90d939849b3 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:15:26.608722 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-52c8e6ba-f4ec-43a6-b37a-b90d939849b3 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:15:26.609485 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-52c8e6ba-f4ec-43a6-b37a-b90d939849b3 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:15:26.609918 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-52c8e6ba-f4ec-43a6-b37a-b90d939849b3 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:15:26.625153 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.wsgi [None req-52c8e6ba-f4ec-43a6-b37a-b90d939849b3 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] HTTP exception thrown: Instance dff45473-c8cb-40c9-8cbb-bc98056c340a could not be found. Jul 21 20:15:26.627131 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-52c8e6ba-f4ec-43a6-b37a-b90d939849b3 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Request method failure captured: Jul 21 20:15:26.627131 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: request: GET /compute/v2.1/servers/dff45473-c8cb-40c9-8cbb-bc98056c340a HTTP/1.1 Jul 21 20:15:26.627131 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Accept: application/json Jul 21 20:15:26.627131 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Accept-Encoding: identity Jul 21 20:15:26.627131 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Connection: close Jul 21 20:15:26.627131 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Content-Length: 0 Jul 21 20:15:26.627131 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Content-Type: application/json Jul 21 20:15:26.627131 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Host: 10.222.0.58 Jul 21 20:15:26.627131 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Openstack-System-Scope: None Jul 21 20:15:26.627131 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: User-Agent: python-urllib3/1.26.9 Jul 21 20:15:26.627131 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Auth-Token: gAAAAABi2bFqawBPFOQp1wWmwqJOOXeis8PNAU6t8AByTK4V8YRXmgW1TS61qGCWegZqRl0cYUnZg1X1Pj-fJHVOTSfoJUElaXEpJN_utV820G7q93tULhE4p8bZ2t6owNOiWk_ziZzytmo_LcxBwsurYvzIMPkunF875WGX-vUiLw6yUYkuMzU Jul 21 20:15:26.627131 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Domain-Id: None Jul 21 20:15:26.627131 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Domain-Name: None Jul 21 20:15:26.627131 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Identity-Status: Confirmed Jul 21 20:15:26.627131 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Is-Admin-Project: True Jul 21 20:15:26.627131 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Id: default Jul 21 20:15:26.627131 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Name: Default Jul 21 20:15:26.627131 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Id: f5e462e9247c4feab7e498186a547728 Jul 21 20:15:26.627131 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Name: tempest-AttachVolumeTestJSON-1902670070 Jul 21 20:15:26.627131 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Role: reader,member Jul 21 20:15:26.627131 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Roles: reader,member Jul 21 20:15:26.629009 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f5e462e9247c4feab7e498186a547728"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f5e462e9247c4feab7e498186a547728"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f5e462e9247c4feab7e498186a547728"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f5e462e9247c4feab7e498186a547728"}]}] Jul 21 20:15:26.629009 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Tenant: tempest-AttachVolumeTestJSON-1902670070 Jul 21 20:15:26.629009 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Tenant-Id: f5e462e9247c4feab7e498186a547728 Jul 21 20:15:26.629009 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1902670070 Jul 21 20:15:26.629009 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User: tempest-AttachVolumeTestJSON-1902670070-project Jul 21 20:15:26.629009 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Id: default Jul 21 20:15:26.629009 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Name: Default Jul 21 20:15:26.629009 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Id: 44f668466fa542039e88b4fc7714de81 Jul 21 20:15:26.629009 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Name: tempest-AttachVolumeTestJSON-1902670070-project Jul 21 20:15:26.629009 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: method: > Jul 21 20:15:26.629009 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: exception: Instance dff45473-c8cb-40c9-8cbb-bc98056c340a could not be found. Jul 21 20:15:26.629009 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: action_args: {'id': 'dff45473-c8cb-40c9-8cbb-bc98056c340a'} Jul 21 20:15:26.633329 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 20:15:26.633329 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:15:26.633329 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 20:15:26.633329 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 20:15:26.633329 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 20:15:26.633329 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 20:15:26.633329 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 20:15:26.633329 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 20:15:26.633329 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 20:15:26.633329 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 20:15:26.633329 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dff45473-c8cb-40c9-8cbb-bc98056c340a could not be found. Jul 21 20:15:26.633329 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:15:26.633329 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:15:26.633329 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:15:26.633329 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:15:26.633329 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:15:26.633329 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:15:26.633329 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 20:15:26.633329 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 20:15:26.633329 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 20:15:26.634752 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 20:15:26.634752 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 20:15:26.634752 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 20:15:26.634752 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 20:15:26.634752 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 20:15:26.634752 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 20:15:26.634752 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 20:15:26.634752 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dff45473-c8cb-40c9-8cbb-bc98056c340a could not be found. Jul 21 20:15:26.634752 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:15:26.634752 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:15:26.634752 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:15:26.634752 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:15:26.634752 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:15:26.634752 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:15:26.634752 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 20:15:26.634752 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 20:15:26.634752 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dff45473-c8cb-40c9-8cbb-bc98056c340a could not be found. Jul 21 20:15:26.634752 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:15:26.635872 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-52c8e6ba-f4ec-43a6-b37a-b90d939849b3 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Returning 404 to user: Instance dff45473-c8cb-40c9-8cbb-bc98056c340a could not be found. {{(pid=118345) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 20:15:26.635872 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-52c8e6ba-f4ec-43a6-b37a-b90d939849b3 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/dff45473-c8cb-40c9-8cbb-bc98056c340a" status: 404 len: 111 microversion: 2.1 time: 0.031354 Jul 21 20:15:26.635872 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 485/946] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:15:26 2022] GET /compute/v2.1/servers/dff45473-c8cb-40c9-8cbb-bc98056c340a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 20:15:26.641672 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-aff04c57-06e8-47b3-9ddd-b46618436fa6 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '.version_select at 0x7f351cb7a040>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:15:26.681789 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-ec06d611-7672-4e26-85d9-b02ddf11bf5a tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:15:26.683713 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-ec06d611-7672-4e26-85d9-b02ddf11bf5a tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] [instance: 80714390-c8b6-4703-a02a-d41fafad3540] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:15:26.691687 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ec06d611-7672-4e26-85d9-b02ddf11bf5a tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:15:26.692564 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ec06d611-7672-4e26-85d9-b02ddf11bf5a tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:15:26.693687 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ec06d611-7672-4e26-85d9-b02ddf11bf5a tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:15:26.694125 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ec06d611-7672-4e26-85d9-b02ddf11bf5a tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:15:26.793007 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-aff04c57-06e8-47b3-9ddd-b46618436fa6 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1717438764" status: 202 len: 0 microversion: 2.1 time: 0.150780 Jul 21 20:15:26.796939 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 462/947] 10.222.0.58 () {58 vars in 1220 bytes} [Thu Jul 21 20:15:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1717438764 => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 20:15:26.950374 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-ec06d611-7672-4e26-85d9-b02ddf11bf5a tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4460571d9294e38931274a55c6c5857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a259cf4b240fba9b065a43b2ed4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:15:26.959385 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-ec06d611-7672-4e26-85d9-b02ddf11bf5a tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] 10.222.0.58 "GET /compute/v2.1/servers/80714390-c8b6-4703-a02a-d41fafad3540" status: 200 len: 1278 microversion: 2.1 time: 0.282195 Jul 21 20:15:26.960318 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 486/948] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:15:26 2022] GET /compute/v2.1/servers/80714390-c8b6-4703-a02a-d41fafad3540 => generated 1278 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:15:27.178043 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [req-ec2e1491-5bae-4fd6-83fb-703385fd9923 req-4e805c5b-439f-4b3d-8fbf-e102f717ae9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80714390-c8b6-4703-a02a-d41fafad3540", "tag": "3dca572c-2bd0-4b29-aed9-3c6afedba8c9"}]} {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:15:27.191599 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [req-ec2e1491-5bae-4fd6-83fb-703385fd9923 req-4e805c5b-439f-4b3d-8fbf-e102f717ae9e service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:15:27.192048 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [req-ec2e1491-5bae-4fd6-83fb-703385fd9923 req-4e805c5b-439f-4b3d-8fbf-e102f717ae9e service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:15:27.206037 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.compute.server_external_events [req-ec2e1491-5bae-4fd6-83fb-703385fd9923 req-4e805c5b-439f-4b3d-8fbf-e102f717ae9e service nova] Creating event network-changed:3dca572c-2bd0-4b29-aed9-3c6afedba8c9 for instance 80714390-c8b6-4703-a02a-d41fafad3540 on hv-cinder-85054 Jul 21 20:15:27.218505 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [req-ec2e1491-5bae-4fd6-83fb-703385fd9923 req-4e805c5b-439f-4b3d-8fbf-e102f717ae9e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048110 Jul 21 20:15:27.220330 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 463/949] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 20:15:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:15:27.982677 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-2eb1168f-4093-460b-8ee0-ba0b6534774e tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:15:27.983807 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-2eb1168f-4093-460b-8ee0-ba0b6534774e tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] [instance: 80714390-c8b6-4703-a02a-d41fafad3540] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:15:27.990550 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2eb1168f-4093-460b-8ee0-ba0b6534774e tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:15:27.990903 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2eb1168f-4093-460b-8ee0-ba0b6534774e tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:15:27.992061 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2eb1168f-4093-460b-8ee0-ba0b6534774e tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:15:27.992505 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2eb1168f-4093-460b-8ee0-ba0b6534774e tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:15:28.145020 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-2eb1168f-4093-460b-8ee0-ba0b6534774e tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4460571d9294e38931274a55c6c5857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a259cf4b240fba9b065a43b2ed4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:15:28.152494 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-2eb1168f-4093-460b-8ee0-ba0b6534774e tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] 10.222.0.58 "GET /compute/v2.1/servers/80714390-c8b6-4703-a02a-d41fafad3540" status: 200 len: 1266 microversion: 2.1 time: 0.178622 Jul 21 20:15:28.152979 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 487/950] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:15:27 2022] GET /compute/v2.1/servers/80714390-c8b6-4703-a02a-d41fafad3540 => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:15:29.170312 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-5541914b-04ef-43ab-90d9-98a37ff3c00f tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:15:29.170996 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-5541914b-04ef-43ab-90d9-98a37ff3c00f tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] [instance: 80714390-c8b6-4703-a02a-d41fafad3540] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:15:29.178118 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-5541914b-04ef-43ab-90d9-98a37ff3c00f tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:15:29.178573 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-5541914b-04ef-43ab-90d9-98a37ff3c00f tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:15:29.179415 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-5541914b-04ef-43ab-90d9-98a37ff3c00f tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:15:29.179914 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-5541914b-04ef-43ab-90d9-98a37ff3c00f tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:15:29.312577 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-5541914b-04ef-43ab-90d9-98a37ff3c00f tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4460571d9294e38931274a55c6c5857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a259cf4b240fba9b065a43b2ed4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:15:29.320092 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-5541914b-04ef-43ab-90d9-98a37ff3c00f tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] 10.222.0.58 "GET /compute/v2.1/servers/80714390-c8b6-4703-a02a-d41fafad3540" status: 200 len: 1266 microversion: 2.1 time: 0.154257 Jul 21 20:15:29.320655 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 464/951] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:15:29 2022] GET /compute/v2.1/servers/80714390-c8b6-4703-a02a-d41fafad3540 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:15:30.257009 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-f044822f-d13d-46f8-99f2-7b98a542dd8f tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:15:30.257507 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-f044822f-d13d-46f8-99f2-7b98a542dd8f tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: dff45473-c8cb-40c9-8cbb-bc98056c340a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:15:30.263601 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f044822f-d13d-46f8-99f2-7b98a542dd8f tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:15:30.272683 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f044822f-d13d-46f8-99f2-7b98a542dd8f tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:15:30.272683 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f044822f-d13d-46f8-99f2-7b98a542dd8f tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:15:30.272683 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f044822f-d13d-46f8-99f2-7b98a542dd8f tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:15:30.278184 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.wsgi [None req-f044822f-d13d-46f8-99f2-7b98a542dd8f tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] HTTP exception thrown: Instance dff45473-c8cb-40c9-8cbb-bc98056c340a could not be found. Jul 21 20:15:30.279790 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-f044822f-d13d-46f8-99f2-7b98a542dd8f tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Request method failure captured: Jul 21 20:15:30.279790 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: request: DELETE /compute/v2.1/servers/dff45473-c8cb-40c9-8cbb-bc98056c340a HTTP/1.1 Jul 21 20:15:30.279790 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Accept: application/json Jul 21 20:15:30.279790 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Accept-Encoding: identity Jul 21 20:15:30.279790 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Connection: close Jul 21 20:15:30.279790 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Content-Length: 0 Jul 21 20:15:30.279790 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Content-Type: application/json Jul 21 20:15:30.279790 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Host: 10.222.0.58 Jul 21 20:15:30.279790 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Openstack-System-Scope: None Jul 21 20:15:30.279790 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: User-Agent: python-urllib3/1.26.9 Jul 21 20:15:30.279790 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Auth-Token: gAAAAABi2bFqawBPFOQp1wWmwqJOOXeis8PNAU6t8AByTK4V8YRXmgW1TS61qGCWegZqRl0cYUnZg1X1Pj-fJHVOTSfoJUElaXEpJN_utV820G7q93tULhE4p8bZ2t6owNOiWk_ziZzytmo_LcxBwsurYvzIMPkunF875WGX-vUiLw6yUYkuMzU Jul 21 20:15:30.279790 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Domain-Id: None Jul 21 20:15:30.279790 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Domain-Name: None Jul 21 20:15:30.279790 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Identity-Status: Confirmed Jul 21 20:15:30.279790 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Is-Admin-Project: True Jul 21 20:15:30.279790 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Id: default Jul 21 20:15:30.279790 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Name: Default Jul 21 20:15:30.279790 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Id: f5e462e9247c4feab7e498186a547728 Jul 21 20:15:30.279790 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Name: tempest-AttachVolumeTestJSON-1902670070 Jul 21 20:15:30.279790 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Role: reader,member Jul 21 20:15:30.279790 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Roles: reader,member Jul 21 20:15:30.281334 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f5e462e9247c4feab7e498186a547728"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f5e462e9247c4feab7e498186a547728"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f5e462e9247c4feab7e498186a547728"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f5e462e9247c4feab7e498186a547728"}]}] Jul 21 20:15:30.281334 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Tenant: tempest-AttachVolumeTestJSON-1902670070 Jul 21 20:15:30.281334 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Tenant-Id: f5e462e9247c4feab7e498186a547728 Jul 21 20:15:30.281334 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1902670070 Jul 21 20:15:30.281334 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User: tempest-AttachVolumeTestJSON-1902670070-project Jul 21 20:15:30.281334 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Id: default Jul 21 20:15:30.281334 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Name: Default Jul 21 20:15:30.281334 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Id: 44f668466fa542039e88b4fc7714de81 Jul 21 20:15:30.281334 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Name: tempest-AttachVolumeTestJSON-1902670070-project Jul 21 20:15:30.281334 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: method: > Jul 21 20:15:30.281334 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: exception: Instance dff45473-c8cb-40c9-8cbb-bc98056c340a could not be found. Jul 21 20:15:30.281334 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: action_args: {'id': 'dff45473-c8cb-40c9-8cbb-bc98056c340a'} Jul 21 20:15:30.282195 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 20:15:30.282195 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:15:30.282195 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 20:15:30.282195 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 20:15:30.282195 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 20:15:30.282195 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 20:15:30.282195 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 20:15:30.282195 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 20:15:30.282195 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 20:15:30.282195 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 20:15:30.282195 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dff45473-c8cb-40c9-8cbb-bc98056c340a could not be found. Jul 21 20:15:30.282195 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:15:30.282195 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:15:30.282195 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:15:30.282195 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:15:30.282195 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:15:30.282195 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:15:30.282195 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 20:15:30.282195 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 20:15:30.282195 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 20:15:30.283625 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 20:15:30.283625 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 20:15:30.283625 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 20:15:30.283625 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 20:15:30.283625 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 20:15:30.283625 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 20:15:30.283625 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 20:15:30.283625 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 20:15:30.283625 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 20:15:30.283625 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dff45473-c8cb-40c9-8cbb-bc98056c340a could not be found. Jul 21 20:15:30.283625 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:15:30.283625 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:15:30.283625 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:15:30.283625 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:15:30.283625 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:15:30.283625 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:15:30.283625 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 20:15:30.283625 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 20:15:30.283625 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dff45473-c8cb-40c9-8cbb-bc98056c340a could not be found. Jul 21 20:15:30.283625 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:15:30.285640 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-f044822f-d13d-46f8-99f2-7b98a542dd8f tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Returning 404 to user: Instance dff45473-c8cb-40c9-8cbb-bc98056c340a could not be found. {{(pid=118345) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 20:15:30.285640 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-f044822f-d13d-46f8-99f2-7b98a542dd8f tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "DELETE /compute/v2.1/servers/dff45473-c8cb-40c9-8cbb-bc98056c340a" status: 404 len: 111 microversion: 2.1 time: 0.027941 Jul 21 20:15:30.285640 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 488/952] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Jul 21 20:15:30 2022] DELETE /compute/v2.1/servers/dff45473-c8cb-40c9-8cbb-bc98056c340a => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 20:15:30.290154 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-a0744652-f9c2-46fb-951e-41c470b9472c tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:15:30.290771 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-a0744652-f9c2-46fb-951e-41c470b9472c tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: dff45473-c8cb-40c9-8cbb-bc98056c340a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:15:30.297461 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-a0744652-f9c2-46fb-951e-41c470b9472c tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:15:30.297902 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-a0744652-f9c2-46fb-951e-41c470b9472c tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:15:30.298666 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-a0744652-f9c2-46fb-951e-41c470b9472c tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:15:30.299153 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-a0744652-f9c2-46fb-951e-41c470b9472c tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:15:30.313054 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.wsgi [None req-a0744652-f9c2-46fb-951e-41c470b9472c tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] HTTP exception thrown: Instance dff45473-c8cb-40c9-8cbb-bc98056c340a could not be found. Jul 21 20:15:30.314647 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-a0744652-f9c2-46fb-951e-41c470b9472c tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Request method failure captured: Jul 21 20:15:30.314647 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: request: GET /compute/v2.1/servers/dff45473-c8cb-40c9-8cbb-bc98056c340a HTTP/1.1 Jul 21 20:15:30.314647 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Accept: application/json Jul 21 20:15:30.314647 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Accept-Encoding: identity Jul 21 20:15:30.314647 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Connection: close Jul 21 20:15:30.314647 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Content-Length: 0 Jul 21 20:15:30.314647 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Content-Type: application/json Jul 21 20:15:30.314647 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Host: 10.222.0.58 Jul 21 20:15:30.314647 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Openstack-System-Scope: None Jul 21 20:15:30.314647 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: User-Agent: python-urllib3/1.26.9 Jul 21 20:15:30.314647 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Auth-Token: gAAAAABi2bFqawBPFOQp1wWmwqJOOXeis8PNAU6t8AByTK4V8YRXmgW1TS61qGCWegZqRl0cYUnZg1X1Pj-fJHVOTSfoJUElaXEpJN_utV820G7q93tULhE4p8bZ2t6owNOiWk_ziZzytmo_LcxBwsurYvzIMPkunF875WGX-vUiLw6yUYkuMzU Jul 21 20:15:30.314647 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Domain-Id: None Jul 21 20:15:30.314647 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Domain-Name: None Jul 21 20:15:30.314647 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Identity-Status: Confirmed Jul 21 20:15:30.314647 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Is-Admin-Project: True Jul 21 20:15:30.314647 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Domain-Id: default Jul 21 20:15:30.314647 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Domain-Name: Default Jul 21 20:15:30.314647 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Id: f5e462e9247c4feab7e498186a547728 Jul 21 20:15:30.314647 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Name: tempest-AttachVolumeTestJSON-1902670070 Jul 21 20:15:30.314647 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Role: reader,member Jul 21 20:15:30.314647 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Roles: reader,member Jul 21 20:15:30.316148 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f5e462e9247c4feab7e498186a547728"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f5e462e9247c4feab7e498186a547728"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f5e462e9247c4feab7e498186a547728"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f5e462e9247c4feab7e498186a547728"}]}] Jul 21 20:15:30.316148 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Tenant: tempest-AttachVolumeTestJSON-1902670070 Jul 21 20:15:30.316148 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Tenant-Id: f5e462e9247c4feab7e498186a547728 Jul 21 20:15:30.316148 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1902670070 Jul 21 20:15:30.316148 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User: tempest-AttachVolumeTestJSON-1902670070-project Jul 21 20:15:30.316148 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Domain-Id: default Jul 21 20:15:30.316148 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Domain-Name: Default Jul 21 20:15:30.316148 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Id: 44f668466fa542039e88b4fc7714de81 Jul 21 20:15:30.316148 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Name: tempest-AttachVolumeTestJSON-1902670070-project Jul 21 20:15:30.316148 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: method: > Jul 21 20:15:30.316148 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: exception: Instance dff45473-c8cb-40c9-8cbb-bc98056c340a could not be found. Jul 21 20:15:30.316148 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: action_args: {'id': 'dff45473-c8cb-40c9-8cbb-bc98056c340a'} Jul 21 20:15:30.316998 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 20:15:30.316998 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:15:30.316998 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 20:15:30.316998 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 20:15:30.316998 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 20:15:30.316998 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 20:15:30.316998 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 20:15:30.316998 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 20:15:30.316998 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 20:15:30.316998 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 20:15:30.316998 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dff45473-c8cb-40c9-8cbb-bc98056c340a could not be found. Jul 21 20:15:30.316998 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:15:30.316998 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:15:30.316998 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:15:30.316998 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:15:30.316998 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:15:30.316998 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:15:30.316998 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 20:15:30.316998 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 20:15:30.316998 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 20:15:30.318391 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 20:15:30.318391 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 20:15:30.318391 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 20:15:30.318391 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 20:15:30.318391 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 20:15:30.318391 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 20:15:30.318391 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 20:15:30.318391 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dff45473-c8cb-40c9-8cbb-bc98056c340a could not be found. Jul 21 20:15:30.318391 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:15:30.318391 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:15:30.318391 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:15:30.318391 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:15:30.318391 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:15:30.318391 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:15:30.318391 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 20:15:30.318391 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 20:15:30.318391 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dff45473-c8cb-40c9-8cbb-bc98056c340a could not be found. Jul 21 20:15:30.318391 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:15:30.320003 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-a0744652-f9c2-46fb-951e-41c470b9472c tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Returning 404 to user: Instance dff45473-c8cb-40c9-8cbb-bc98056c340a could not be found. {{(pid=118344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 20:15:30.320003 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-a0744652-f9c2-46fb-951e-41c470b9472c tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/dff45473-c8cb-40c9-8cbb-bc98056c340a" status: 404 len: 111 microversion: 2.1 time: 0.029920 Jul 21 20:15:30.320003 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 465/953] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:15:30 2022] GET /compute/v2.1/servers/dff45473-c8cb-40c9-8cbb-bc98056c340a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 20:15:30.336164 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-f7ad3543-7e06-4dda-8310-5068d285eb52 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:15:30.336771 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-f7ad3543-7e06-4dda-8310-5068d285eb52 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] [instance: 80714390-c8b6-4703-a02a-d41fafad3540] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:15:30.342807 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f7ad3543-7e06-4dda-8310-5068d285eb52 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:15:30.343459 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f7ad3543-7e06-4dda-8310-5068d285eb52 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:15:30.344215 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f7ad3543-7e06-4dda-8310-5068d285eb52 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:15:30.344640 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f7ad3543-7e06-4dda-8310-5068d285eb52 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:15:30.363753 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:15:30.481596 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-f7ad3543-7e06-4dda-8310-5068d285eb52 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4460571d9294e38931274a55c6c5857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a259cf4b240fba9b065a43b2ed4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:15:30.489740 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-f7ad3543-7e06-4dda-8310-5068d285eb52 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] 10.222.0.58 "GET /compute/v2.1/servers/80714390-c8b6-4703-a02a-d41fafad3540" status: 200 len: 1266 microversion: 2.1 time: 0.157282 Jul 21 20:15:30.490236 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 489/954] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:15:30 2022] GET /compute/v2.1/servers/80714390-c8b6-4703-a02a-d41fafad3540 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:15:31.506566 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-45e80992-106c-43c1-80e5-9eb5a7be01a3 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:15:31.507197 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-45e80992-106c-43c1-80e5-9eb5a7be01a3 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] [instance: 80714390-c8b6-4703-a02a-d41fafad3540] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:15:31.513753 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-45e80992-106c-43c1-80e5-9eb5a7be01a3 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:15:31.514157 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-45e80992-106c-43c1-80e5-9eb5a7be01a3 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:15:31.514910 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-45e80992-106c-43c1-80e5-9eb5a7be01a3 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:15:31.515361 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-45e80992-106c-43c1-80e5-9eb5a7be01a3 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:15:31.656179 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-0f17521a-eba5-417f-b4d7-351ead34f22f tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:15:31.656758 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-0f17521a-eba5-417f-b4d7-351ead34f22f tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:15:31.664230 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0f17521a-eba5-417f-b4d7-351ead34f22f tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:15:31.664771 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0f17521a-eba5-417f-b4d7-351ead34f22f tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:15:31.665561 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0f17521a-eba5-417f-b4d7-351ead34f22f tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:15:31.665998 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0f17521a-eba5-417f-b4d7-351ead34f22f tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:15:31.680769 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.wsgi [None req-0f17521a-eba5-417f-b4d7-351ead34f22f tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] HTTP exception thrown: Instance 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a could not be found. Jul 21 20:15:31.682332 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-0f17521a-eba5-417f-b4d7-351ead34f22f tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Request method failure captured: Jul 21 20:15:31.682332 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: request: DELETE /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a HTTP/1.1 Jul 21 20:15:31.682332 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Accept: application/json Jul 21 20:15:31.682332 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Accept-Encoding: identity Jul 21 20:15:31.682332 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Connection: close Jul 21 20:15:31.682332 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Content-Length: 0 Jul 21 20:15:31.682332 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Content-Type: application/json Jul 21 20:15:31.682332 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Host: 10.222.0.58 Jul 21 20:15:31.682332 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Openstack-System-Scope: None Jul 21 20:15:31.682332 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: User-Agent: python-urllib3/1.26.9 Jul 21 20:15:31.682332 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Auth-Token: gAAAAABi2bFqawBPFOQp1wWmwqJOOXeis8PNAU6t8AByTK4V8YRXmgW1TS61qGCWegZqRl0cYUnZg1X1Pj-fJHVOTSfoJUElaXEpJN_utV820G7q93tULhE4p8bZ2t6owNOiWk_ziZzytmo_LcxBwsurYvzIMPkunF875WGX-vUiLw6yUYkuMzU Jul 21 20:15:31.682332 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Domain-Id: None Jul 21 20:15:31.682332 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Domain-Name: None Jul 21 20:15:31.682332 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Identity-Status: Confirmed Jul 21 20:15:31.682332 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Is-Admin-Project: True Jul 21 20:15:31.682332 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Id: default Jul 21 20:15:31.682332 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Name: Default Jul 21 20:15:31.682332 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Id: f5e462e9247c4feab7e498186a547728 Jul 21 20:15:31.682332 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Name: tempest-AttachVolumeTestJSON-1902670070 Jul 21 20:15:31.682332 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Role: reader,member Jul 21 20:15:31.682332 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Roles: reader,member Jul 21 20:15:31.683643 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f5e462e9247c4feab7e498186a547728"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f5e462e9247c4feab7e498186a547728"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f5e462e9247c4feab7e498186a547728"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f5e462e9247c4feab7e498186a547728"}]}] Jul 21 20:15:31.683643 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Tenant: tempest-AttachVolumeTestJSON-1902670070 Jul 21 20:15:31.683643 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Tenant-Id: f5e462e9247c4feab7e498186a547728 Jul 21 20:15:31.683643 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1902670070 Jul 21 20:15:31.683643 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User: tempest-AttachVolumeTestJSON-1902670070-project Jul 21 20:15:31.683643 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Id: default Jul 21 20:15:31.683643 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Name: Default Jul 21 20:15:31.683643 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Id: 44f668466fa542039e88b4fc7714de81 Jul 21 20:15:31.683643 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Name: tempest-AttachVolumeTestJSON-1902670070-project Jul 21 20:15:31.683643 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: method: > Jul 21 20:15:31.683643 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: exception: Instance 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a could not be found. Jul 21 20:15:31.683643 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: action_args: {'id': '4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a'} Jul 21 20:15:31.684391 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 20:15:31.684391 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:15:31.684391 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 20:15:31.684391 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 20:15:31.684391 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 20:15:31.684391 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 20:15:31.684391 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 20:15:31.684391 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 20:15:31.684391 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 20:15:31.684391 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 20:15:31.684391 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a could not be found. Jul 21 20:15:31.684391 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:15:31.684391 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:15:31.684391 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:15:31.684391 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:15:31.684391 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:15:31.684391 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:15:31.684391 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 20:15:31.684391 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 20:15:31.684391 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 20:15:31.688722 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 20:15:31.688722 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 20:15:31.688722 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 20:15:31.688722 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 20:15:31.688722 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 20:15:31.688722 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 20:15:31.688722 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 20:15:31.688722 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 20:15:31.688722 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 20:15:31.688722 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a could not be found. Jul 21 20:15:31.688722 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:15:31.688722 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:15:31.688722 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:15:31.688722 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:15:31.688722 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:15:31.688722 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:15:31.688722 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 20:15:31.688722 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 20:15:31.688722 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a could not be found. Jul 21 20:15:31.688722 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:15:31.689946 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-0f17521a-eba5-417f-b4d7-351ead34f22f tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Returning 404 to user: Instance 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a could not be found. {{(pid=118345) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 20:15:31.689946 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-0f17521a-eba5-417f-b4d7-351ead34f22f tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "DELETE /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a" status: 404 len: 111 microversion: 2.1 time: 0.032066 Jul 21 20:15:31.689946 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 490/955] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Jul 21 20:15:31 2022] DELETE /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 21 20:15:31.692584 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-58b998f0-9623-4b43-afe7-122bd0466291 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:15:31.693193 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-58b998f0-9623-4b43-afe7-122bd0466291 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] [instance: 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:15:31.699825 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-58b998f0-9623-4b43-afe7-122bd0466291 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:15:31.700275 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-58b998f0-9623-4b43-afe7-122bd0466291 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:15:31.701041 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-58b998f0-9623-4b43-afe7-122bd0466291 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:15:31.701523 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-58b998f0-9623-4b43-afe7-122bd0466291 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:15:31.715095 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.wsgi [None req-58b998f0-9623-4b43-afe7-122bd0466291 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] HTTP exception thrown: Instance 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a could not be found. Jul 21 20:15:31.716890 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-58b998f0-9623-4b43-afe7-122bd0466291 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Request method failure captured: Jul 21 20:15:31.716890 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: request: GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a HTTP/1.1 Jul 21 20:15:31.716890 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Accept: application/json Jul 21 20:15:31.716890 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Accept-Encoding: identity Jul 21 20:15:31.716890 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Connection: close Jul 21 20:15:31.716890 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Content-Length: 0 Jul 21 20:15:31.716890 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Content-Type: application/json Jul 21 20:15:31.716890 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Host: 10.222.0.58 Jul 21 20:15:31.716890 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Openstack-System-Scope: None Jul 21 20:15:31.716890 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: User-Agent: python-urllib3/1.26.9 Jul 21 20:15:31.716890 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Auth-Token: gAAAAABi2bFqawBPFOQp1wWmwqJOOXeis8PNAU6t8AByTK4V8YRXmgW1TS61qGCWegZqRl0cYUnZg1X1Pj-fJHVOTSfoJUElaXEpJN_utV820G7q93tULhE4p8bZ2t6owNOiWk_ziZzytmo_LcxBwsurYvzIMPkunF875WGX-vUiLw6yUYkuMzU Jul 21 20:15:31.716890 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Domain-Id: None Jul 21 20:15:31.716890 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Domain-Name: None Jul 21 20:15:31.716890 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Identity-Status: Confirmed Jul 21 20:15:31.716890 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Is-Admin-Project: True Jul 21 20:15:31.716890 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Id: default Jul 21 20:15:31.716890 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Name: Default Jul 21 20:15:31.716890 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Id: f5e462e9247c4feab7e498186a547728 Jul 21 20:15:31.716890 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Name: tempest-AttachVolumeTestJSON-1902670070 Jul 21 20:15:31.716890 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Role: reader,member Jul 21 20:15:31.716890 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Roles: reader,member Jul 21 20:15:31.718845 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f5e462e9247c4feab7e498186a547728"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f5e462e9247c4feab7e498186a547728"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f5e462e9247c4feab7e498186a547728"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f5e462e9247c4feab7e498186a547728"}]}] Jul 21 20:15:31.718845 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Tenant: tempest-AttachVolumeTestJSON-1902670070 Jul 21 20:15:31.718845 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Tenant-Id: f5e462e9247c4feab7e498186a547728 Jul 21 20:15:31.718845 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1902670070 Jul 21 20:15:31.718845 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User: tempest-AttachVolumeTestJSON-1902670070-project Jul 21 20:15:31.718845 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Id: default Jul 21 20:15:31.718845 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Name: Default Jul 21 20:15:31.718845 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Id: 44f668466fa542039e88b4fc7714de81 Jul 21 20:15:31.718845 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Name: tempest-AttachVolumeTestJSON-1902670070-project Jul 21 20:15:31.718845 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: method: > Jul 21 20:15:31.718845 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: exception: Instance 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a could not be found. Jul 21 20:15:31.718845 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: action_args: {'id': '4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a'} Jul 21 20:15:31.719622 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 20:15:31.719622 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:15:31.719622 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 20:15:31.719622 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 20:15:31.719622 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 20:15:31.719622 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 20:15:31.719622 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 20:15:31.719622 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 20:15:31.719622 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 20:15:31.719622 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 20:15:31.719622 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a could not be found. Jul 21 20:15:31.719622 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:15:31.719622 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:15:31.719622 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:15:31.719622 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:15:31.719622 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:15:31.719622 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:15:31.719622 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 20:15:31.719622 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 20:15:31.719622 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 20:15:31.722515 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 20:15:31.722515 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 20:15:31.722515 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 20:15:31.722515 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 20:15:31.722515 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 20:15:31.722515 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 20:15:31.722515 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 20:15:31.722515 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a could not be found. Jul 21 20:15:31.722515 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:15:31.722515 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:15:31.722515 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:15:31.722515 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:15:31.722515 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:15:31.722515 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:15:31.722515 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 20:15:31.722515 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 20:15:31.722515 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a could not be found. Jul 21 20:15:31.722515 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:15:31.724935 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-58b998f0-9623-4b43-afe7-122bd0466291 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] Returning 404 to user: Instance 4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a could not be found. {{(pid=118345) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 20:15:31.724935 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-58b998f0-9623-4b43-afe7-122bd0466291 tempest-AttachVolumeTestJSON-1902670070 tempest-AttachVolumeTestJSON-1902670070-project] 10.222.0.58 "GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a" status: 404 len: 111 microversion: 2.1 time: 0.029843 Jul 21 20:15:31.724935 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 491/956] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:15:31 2022] GET /compute/v2.1/servers/4e40f57c-9f0d-41a0-add7-8d5c3ad1fd5a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 20:15:31.732511 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG dbcounter [-] [118344] Writing DB stats nova_cell0:SELECT=2 {{(pid=118344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:15:31.752214 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG dbcounter [-] [118344] Writing DB stats nova_cell0:SELECT=6 {{(pid=118344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:15:31.800854 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-45e80992-106c-43c1-80e5-9eb5a7be01a3 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4460571d9294e38931274a55c6c5857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a259cf4b240fba9b065a43b2ed4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:15:31.808303 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-45e80992-106c-43c1-80e5-9eb5a7be01a3 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] 10.222.0.58 "GET /compute/v2.1/servers/80714390-c8b6-4703-a02a-d41fafad3540" status: 200 len: 1266 microversion: 2.1 time: 0.306283 Jul 21 20:15:31.808859 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 466/957] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:15:31 2022] GET /compute/v2.1/servers/80714390-c8b6-4703-a02a-d41fafad3540 => generated 1266 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:15:32.825126 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-1460e760-b5fe-4bc2-8318-1e6b3e70e3bd tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:15:32.825743 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-1460e760-b5fe-4bc2-8318-1e6b3e70e3bd tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] [instance: 80714390-c8b6-4703-a02a-d41fafad3540] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:15:32.827925 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell0:SELECT=2 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:15:32.833155 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1460e760-b5fe-4bc2-8318-1e6b3e70e3bd tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:15:32.833596 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1460e760-b5fe-4bc2-8318-1e6b3e70e3bd tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:15:32.834345 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1460e760-b5fe-4bc2-8318-1e6b3e70e3bd tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:15:32.834849 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1460e760-b5fe-4bc2-8318-1e6b3e70e3bd tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:15:33.037952 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-1460e760-b5fe-4bc2-8318-1e6b3e70e3bd tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4460571d9294e38931274a55c6c5857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a259cf4b240fba9b065a43b2ed4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:15:33.045451 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-1460e760-b5fe-4bc2-8318-1e6b3e70e3bd tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] 10.222.0.58 "GET /compute/v2.1/servers/80714390-c8b6-4703-a02a-d41fafad3540" status: 200 len: 1266 microversion: 2.1 time: 0.224251 Jul 21 20:15:33.046020 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 492/958] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:15:32 2022] GET /compute/v2.1/servers/80714390-c8b6-4703-a02a-d41fafad3540 => generated 1266 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:15:34.065045 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-1f8addd5-f791-422b-9184-69383e1b672f tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:15:34.072219 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-1f8addd5-f791-422b-9184-69383e1b672f tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] [instance: 80714390-c8b6-4703-a02a-d41fafad3540] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:15:34.073809 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-1f8addd5-f791-422b-9184-69383e1b672f tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:15:34.074262 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-1f8addd5-f791-422b-9184-69383e1b672f tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:15:34.075047 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-1f8addd5-f791-422b-9184-69383e1b672f tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:15:34.075487 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-1f8addd5-f791-422b-9184-69383e1b672f tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:15:34.281710 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-1f8addd5-f791-422b-9184-69383e1b672f tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4460571d9294e38931274a55c6c5857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a259cf4b240fba9b065a43b2ed4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:15:34.289355 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-1f8addd5-f791-422b-9184-69383e1b672f tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] 10.222.0.58 "GET /compute/v2.1/servers/80714390-c8b6-4703-a02a-d41fafad3540" status: 200 len: 1266 microversion: 2.1 time: 0.229201 Jul 21 20:15:34.289850 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 467/959] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:15:34 2022] GET /compute/v2.1/servers/80714390-c8b6-4703-a02a-d41fafad3540 => generated 1266 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:15:35.309865 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-a62d4824-88f1-423f-bbde-9da7c145ab04 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:15:35.309865 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-a62d4824-88f1-423f-bbde-9da7c145ab04 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] [instance: 80714390-c8b6-4703-a02a-d41fafad3540] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:15:35.313775 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a62d4824-88f1-423f-bbde-9da7c145ab04 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:15:35.314335 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a62d4824-88f1-423f-bbde-9da7c145ab04 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:15:35.318202 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a62d4824-88f1-423f-bbde-9da7c145ab04 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:15:35.318202 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a62d4824-88f1-423f-bbde-9da7c145ab04 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:15:35.462005 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-a62d4824-88f1-423f-bbde-9da7c145ab04 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4460571d9294e38931274a55c6c5857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a259cf4b240fba9b065a43b2ed4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:15:35.469983 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-a62d4824-88f1-423f-bbde-9da7c145ab04 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] 10.222.0.58 "GET /compute/v2.1/servers/80714390-c8b6-4703-a02a-d41fafad3540" status: 200 len: 1266 microversion: 2.1 time: 0.167634 Jul 21 20:15:35.470576 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 493/960] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:15:35 2022] GET /compute/v2.1/servers/80714390-c8b6-4703-a02a-d41fafad3540 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:15:36.487414 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-a47fdad8-335b-442a-8313-a2413d87c842 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:15:36.488607 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-a47fdad8-335b-442a-8313-a2413d87c842 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] [instance: 80714390-c8b6-4703-a02a-d41fafad3540] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:15:36.495134 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-a47fdad8-335b-442a-8313-a2413d87c842 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:15:36.495586 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-a47fdad8-335b-442a-8313-a2413d87c842 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:15:36.496352 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-a47fdad8-335b-442a-8313-a2413d87c842 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:15:36.496788 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-a47fdad8-335b-442a-8313-a2413d87c842 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:15:36.632298 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-a47fdad8-335b-442a-8313-a2413d87c842 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4460571d9294e38931274a55c6c5857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a259cf4b240fba9b065a43b2ed4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:15:36.639779 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-a47fdad8-335b-442a-8313-a2413d87c842 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] 10.222.0.58 "GET /compute/v2.1/servers/80714390-c8b6-4703-a02a-d41fafad3540" status: 200 len: 1266 microversion: 2.1 time: 0.156469 Jul 21 20:15:36.640338 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 468/961] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:15:36 2022] GET /compute/v2.1/servers/80714390-c8b6-4703-a02a-d41fafad3540 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:15:37.657043 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-2d404624-39bd-44e4-9734-8cd870527edd tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:15:37.660776 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-2d404624-39bd-44e4-9734-8cd870527edd tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] [instance: 80714390-c8b6-4703-a02a-d41fafad3540] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:15:37.664129 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2d404624-39bd-44e4-9734-8cd870527edd tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:15:37.664573 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2d404624-39bd-44e4-9734-8cd870527edd tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:15:37.665333 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2d404624-39bd-44e4-9734-8cd870527edd tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:15:37.665762 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2d404624-39bd-44e4-9734-8cd870527edd tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:15:37.794286 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-2d404624-39bd-44e4-9734-8cd870527edd tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4460571d9294e38931274a55c6c5857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a259cf4b240fba9b065a43b2ed4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:15:37.802658 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-2d404624-39bd-44e4-9734-8cd870527edd tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] 10.222.0.58 "GET /compute/v2.1/servers/80714390-c8b6-4703-a02a-d41fafad3540" status: 200 len: 1266 microversion: 2.1 time: 0.149432 Jul 21 20:15:37.803301 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 494/962] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:15:37 2022] GET /compute/v2.1/servers/80714390-c8b6-4703-a02a-d41fafad3540 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:15:38.820511 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-941f840d-fcb9-4acd-be6b-1991e5822c27 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:15:38.821711 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-941f840d-fcb9-4acd-be6b-1991e5822c27 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] [instance: 80714390-c8b6-4703-a02a-d41fafad3540] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:15:38.829779 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-941f840d-fcb9-4acd-be6b-1991e5822c27 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:15:38.830230 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-941f840d-fcb9-4acd-be6b-1991e5822c27 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:15:38.831005 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-941f840d-fcb9-4acd-be6b-1991e5822c27 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:15:38.831478 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-941f840d-fcb9-4acd-be6b-1991e5822c27 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:15:38.973072 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-941f840d-fcb9-4acd-be6b-1991e5822c27 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4460571d9294e38931274a55c6c5857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a259cf4b240fba9b065a43b2ed4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:15:38.980882 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-941f840d-fcb9-4acd-be6b-1991e5822c27 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] 10.222.0.58 "GET /compute/v2.1/servers/80714390-c8b6-4703-a02a-d41fafad3540" status: 200 len: 1266 microversion: 2.1 time: 0.165267 Jul 21 20:15:38.981645 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 469/963] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:15:38 2022] GET /compute/v2.1/servers/80714390-c8b6-4703-a02a-d41fafad3540 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:15:39.997836 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-f40a47c2-2f76-49a6-88d2-3438b7cf0dcb tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:15:39.998452 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-f40a47c2-2f76-49a6-88d2-3438b7cf0dcb tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] [instance: 80714390-c8b6-4703-a02a-d41fafad3540] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:15:40.004669 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f40a47c2-2f76-49a6-88d2-3438b7cf0dcb tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:15:40.005144 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f40a47c2-2f76-49a6-88d2-3438b7cf0dcb tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:15:40.005912 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f40a47c2-2f76-49a6-88d2-3438b7cf0dcb tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:15:40.006382 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f40a47c2-2f76-49a6-88d2-3438b7cf0dcb tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:15:40.114650 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [req-0374f468-be05-47fb-ae77-60df6c8f1288 req-fa28d97d-4d36-47b9-976c-e149d9ff9ed4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80714390-c8b6-4703-a02a-d41fafad3540", "name": "network-vif-plugged", "status": "completed", "tag": "3dca572c-2bd0-4b29-aed9-3c6afedba8c9"}]} {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:15:40.124033 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [req-0374f468-be05-47fb-ae77-60df6c8f1288 req-fa28d97d-4d36-47b9-976c-e149d9ff9ed4 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:15:40.124715 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [req-0374f468-be05-47fb-ae77-60df6c8f1288 req-fa28d97d-4d36-47b9-976c-e149d9ff9ed4 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:15:40.135833 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.compute.server_external_events [req-0374f468-be05-47fb-ae77-60df6c8f1288 req-fa28d97d-4d36-47b9-976c-e149d9ff9ed4 service nova] Creating event network-vif-plugged:3dca572c-2bd0-4b29-aed9-3c6afedba8c9 for instance 80714390-c8b6-4703-a02a-d41fafad3540 on hv-cinder-85054 Jul 21 20:15:40.140894 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [req-0374f468-be05-47fb-ae77-60df6c8f1288 req-fa28d97d-4d36-47b9-976c-e149d9ff9ed4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032368 Jul 21 20:15:40.141271 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-f40a47c2-2f76-49a6-88d2-3438b7cf0dcb tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4460571d9294e38931274a55c6c5857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a259cf4b240fba9b065a43b2ed4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:15:40.141516 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 470/964] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 20:15:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 20:15:40.149132 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-f40a47c2-2f76-49a6-88d2-3438b7cf0dcb tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] 10.222.0.58 "GET /compute/v2.1/servers/80714390-c8b6-4703-a02a-d41fafad3540" status: 200 len: 1266 microversion: 2.1 time: 0.155232 Jul 21 20:15:40.149743 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 495/965] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:15:39 2022] GET /compute/v2.1/servers/80714390-c8b6-4703-a02a-d41fafad3540 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:15:41.166919 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-57139143-dadb-42ac-b9c3-3c25f72d75e6 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:15:41.167647 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-57139143-dadb-42ac-b9c3-3c25f72d75e6 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] [instance: 80714390-c8b6-4703-a02a-d41fafad3540] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:15:41.173831 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-57139143-dadb-42ac-b9c3-3c25f72d75e6 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:15:41.174277 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-57139143-dadb-42ac-b9c3-3c25f72d75e6 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:15:41.175583 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-57139143-dadb-42ac-b9c3-3c25f72d75e6 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:15:41.176018 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-57139143-dadb-42ac-b9c3-3c25f72d75e6 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:15:41.304828 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-57139143-dadb-42ac-b9c3-3c25f72d75e6 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4460571d9294e38931274a55c6c5857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a259cf4b240fba9b065a43b2ed4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:15:41.312283 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-57139143-dadb-42ac-b9c3-3c25f72d75e6 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] 10.222.0.58 "GET /compute/v2.1/servers/80714390-c8b6-4703-a02a-d41fafad3540" status: 200 len: 1266 microversion: 2.1 time: 0.150083 Jul 21 20:15:41.321086 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 471/966] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:15:41 2022] GET /compute/v2.1/servers/80714390-c8b6-4703-a02a-d41fafad3540 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:15:42.331227 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-f69dc688-6528-45d8-bfcb-d7f7ef9382e0 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:15:42.350403 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-f69dc688-6528-45d8-bfcb-d7f7ef9382e0 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] [instance: 80714390-c8b6-4703-a02a-d41fafad3540] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:15:42.350403 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f69dc688-6528-45d8-bfcb-d7f7ef9382e0 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:15:42.350403 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f69dc688-6528-45d8-bfcb-d7f7ef9382e0 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:15:42.350403 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f69dc688-6528-45d8-bfcb-d7f7ef9382e0 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:15:42.350906 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f69dc688-6528-45d8-bfcb-d7f7ef9382e0 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:15:42.478201 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-f69dc688-6528-45d8-bfcb-d7f7ef9382e0 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4460571d9294e38931274a55c6c5857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a259cf4b240fba9b065a43b2ed4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:15:42.485628 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-f69dc688-6528-45d8-bfcb-d7f7ef9382e0 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] 10.222.0.58 "GET /compute/v2.1/servers/80714390-c8b6-4703-a02a-d41fafad3540" status: 200 len: 1266 microversion: 2.1 time: 0.159323 Jul 21 20:15:42.486194 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 496/967] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:15:42 2022] GET /compute/v2.1/servers/80714390-c8b6-4703-a02a-d41fafad3540 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:15:43.501734 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-74fe1b8c-946c-4757-8768-2e398a577689 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:15:43.502337 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-74fe1b8c-946c-4757-8768-2e398a577689 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] [instance: 80714390-c8b6-4703-a02a-d41fafad3540] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:15:43.510008 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-74fe1b8c-946c-4757-8768-2e398a577689 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:15:43.510892 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-74fe1b8c-946c-4757-8768-2e398a577689 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:15:43.511694 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-74fe1b8c-946c-4757-8768-2e398a577689 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:15:43.512127 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-74fe1b8c-946c-4757-8768-2e398a577689 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:15:43.651675 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-74fe1b8c-946c-4757-8768-2e398a577689 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4460571d9294e38931274a55c6c5857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a259cf4b240fba9b065a43b2ed4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:15:43.659441 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-74fe1b8c-946c-4757-8768-2e398a577689 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] 10.222.0.58 "GET /compute/v2.1/servers/80714390-c8b6-4703-a02a-d41fafad3540" status: 200 len: 1266 microversion: 2.1 time: 0.161517 Jul 21 20:15:43.660528 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 472/968] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:15:43 2022] GET /compute/v2.1/servers/80714390-c8b6-4703-a02a-d41fafad3540 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:15:44.676784 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-6fa4ee6a-8b10-4428-bacf-af8077f79573 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:15:44.677397 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-6fa4ee6a-8b10-4428-bacf-af8077f79573 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] [instance: 80714390-c8b6-4703-a02a-d41fafad3540] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:15:44.683430 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6fa4ee6a-8b10-4428-bacf-af8077f79573 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:15:44.683873 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6fa4ee6a-8b10-4428-bacf-af8077f79573 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:15:44.684633 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6fa4ee6a-8b10-4428-bacf-af8077f79573 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:15:44.685064 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6fa4ee6a-8b10-4428-bacf-af8077f79573 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:15:44.821218 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-6fa4ee6a-8b10-4428-bacf-af8077f79573 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4460571d9294e38931274a55c6c5857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a259cf4b240fba9b065a43b2ed4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:15:44.828558 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-6fa4ee6a-8b10-4428-bacf-af8077f79573 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] 10.222.0.58 "GET /compute/v2.1/servers/80714390-c8b6-4703-a02a-d41fafad3540" status: 200 len: 1266 microversion: 2.1 time: 0.155625 Jul 21 20:15:44.829159 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 497/969] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:15:44 2022] GET /compute/v2.1/servers/80714390-c8b6-4703-a02a-d41fafad3540 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:15:45.845864 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-960c4b10-1c79-40b4-a467-f2816c6205c8 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:15:45.846773 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-960c4b10-1c79-40b4-a467-f2816c6205c8 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] [instance: 80714390-c8b6-4703-a02a-d41fafad3540] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:15:45.853957 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-960c4b10-1c79-40b4-a467-f2816c6205c8 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:15:45.854405 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-960c4b10-1c79-40b4-a467-f2816c6205c8 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:15:45.855210 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-960c4b10-1c79-40b4-a467-f2816c6205c8 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:15:45.855648 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-960c4b10-1c79-40b4-a467-f2816c6205c8 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:15:45.989833 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-960c4b10-1c79-40b4-a467-f2816c6205c8 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4460571d9294e38931274a55c6c5857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a259cf4b240fba9b065a43b2ed4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:15:45.997473 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-960c4b10-1c79-40b4-a467-f2816c6205c8 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] 10.222.0.58 "GET /compute/v2.1/servers/80714390-c8b6-4703-a02a-d41fafad3540" status: 200 len: 1266 microversion: 2.1 time: 0.155546 Jul 21 20:15:46.001881 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 473/970] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:15:45 2022] GET /compute/v2.1/servers/80714390-c8b6-4703-a02a-d41fafad3540 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:15:47.015227 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-8fdb3813-3140-4a7b-a6d6-078ba14c5018 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:15:47.015830 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-8fdb3813-3140-4a7b-a6d6-078ba14c5018 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] [instance: 80714390-c8b6-4703-a02a-d41fafad3540] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:15:47.017724 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:15:47.024159 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8fdb3813-3140-4a7b-a6d6-078ba14c5018 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:15:47.024744 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8fdb3813-3140-4a7b-a6d6-078ba14c5018 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:15:47.026003 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8fdb3813-3140-4a7b-a6d6-078ba14c5018 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:15:47.026728 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8fdb3813-3140-4a7b-a6d6-078ba14c5018 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:15:47.159451 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-8fdb3813-3140-4a7b-a6d6-078ba14c5018 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4460571d9294e38931274a55c6c5857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a259cf4b240fba9b065a43b2ed4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:15:47.167121 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-8fdb3813-3140-4a7b-a6d6-078ba14c5018 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] 10.222.0.58 "GET /compute/v2.1/servers/80714390-c8b6-4703-a02a-d41fafad3540" status: 200 len: 1454 microversion: 2.1 time: 0.155910 Jul 21 20:15:47.167682 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 498/971] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:15:47 2022] GET /compute/v2.1/servers/80714390-c8b6-4703-a02a-d41fafad3540 => generated 1454 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:15:47.183667 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-8867926e-7f54-40ae-a1e0-6db6e7a72fe9 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:15:47.184281 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-8867926e-7f54-40ae-a1e0-6db6e7a72fe9 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] [instance: 80714390-c8b6-4703-a02a-d41fafad3540] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:15:47.190647 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-8867926e-7f54-40ae-a1e0-6db6e7a72fe9 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:15:47.191132 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-8867926e-7f54-40ae-a1e0-6db6e7a72fe9 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:15:47.191895 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-8867926e-7f54-40ae-a1e0-6db6e7a72fe9 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:15:47.192335 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-8867926e-7f54-40ae-a1e0-6db6e7a72fe9 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:15:47.322156 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-8867926e-7f54-40ae-a1e0-6db6e7a72fe9 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4460571d9294e38931274a55c6c5857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a259cf4b240fba9b065a43b2ed4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:15:47.329699 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-8867926e-7f54-40ae-a1e0-6db6e7a72fe9 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] 10.222.0.58 "GET /compute/v2.1/servers/80714390-c8b6-4703-a02a-d41fafad3540" status: 200 len: 1454 microversion: 2.1 time: 0.149902 Jul 21 20:15:47.330261 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 474/972] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:15:47 2022] GET /compute/v2.1/servers/80714390-c8b6-4703-a02a-d41fafad3540 => generated 1454 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:15:49.489310 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [req-4e523e82-26fe-4209-9c74-48c7573a6e9b req-2c1f8eb6-485b-4d9a-88c3-40470b4c646e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80714390-c8b6-4703-a02a-d41fafad3540", "tag": "3dca572c-2bd0-4b29-aed9-3c6afedba8c9"}]} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:15:49.497324 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-4e523e82-26fe-4209-9c74-48c7573a6e9b req-2c1f8eb6-485b-4d9a-88c3-40470b4c646e service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:15:49.500257 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-4e523e82-26fe-4209-9c74-48c7573a6e9b req-2c1f8eb6-485b-4d9a-88c3-40470b4c646e service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:15:49.509277 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.compute.server_external_events [req-4e523e82-26fe-4209-9c74-48c7573a6e9b req-2c1f8eb6-485b-4d9a-88c3-40470b4c646e service nova] Creating event network-changed:3dca572c-2bd0-4b29-aed9-3c6afedba8c9 for instance 80714390-c8b6-4703-a02a-d41fafad3540 on hv-cinder-85054 Jul 21 20:15:49.514476 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [req-4e523e82-26fe-4209-9c74-48c7573a6e9b req-2c1f8eb6-485b-4d9a-88c3-40470b4c646e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155352 Jul 21 20:15:49.515455 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 499/973] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 20:15:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 20:15:56.805131 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-9a34ca5a-3cb1-4623-b27f-57ac5e64f2ae tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:15:56.805633 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-9a34ca5a-3cb1-4623-b27f-57ac5e64f2ae tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 392749b4-22f6-470d-9b2e-4a9b2ded152b] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:15:56.808259 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG dbcounter [-] [118344] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=118344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:15:56.812974 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-9a34ca5a-3cb1-4623-b27f-57ac5e64f2ae tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:15:56.813415 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-9a34ca5a-3cb1-4623-b27f-57ac5e64f2ae tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:15:56.814194 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-9a34ca5a-3cb1-4623-b27f-57ac5e64f2ae tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:15:56.814615 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-9a34ca5a-3cb1-4623-b27f-57ac5e64f2ae tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:15:56.818157 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG dbcounter [-] [118344] Writing DB stats nova_cell1:SELECT=74 {{(pid=118344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:15:56.837377 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-9a34ca5a-3cb1-4623-b27f-57ac5e64f2ae tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/392749b4-22f6-470d-9b2e-4a9b2ded152b/ips" status: 200 len: 149 microversion: 2.1 time: 0.036177 Jul 21 20:15:56.837936 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 475/974] 10.222.0.58 () {58 vars in 1247 bytes} [Thu Jul 21 20:15:56 2022] GET /compute/v2.1/servers/392749b4-22f6-470d-9b2e-4a9b2ded152b/ips => generated 149 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:15:59.515836 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_api:SELECT=3 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:15:59.519893 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell1:SELECT=50 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:15:59.520818 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-6f78810c-5a40-4bf6-ac08-e92a63476717 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e4a9d759-f3ad-400c-9c80-b103ce1caead"}} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:15:59.521970 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-6f78810c-5a40-4bf6-ac08-e92a63476717 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 392749b4-22f6-470d-9b2e-4a9b2ded152b] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:15:59.527992 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6f78810c-5a40-4bf6-ac08-e92a63476717 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:15:59.528442 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6f78810c-5a40-4bf6-ac08-e92a63476717 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:15:59.529330 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6f78810c-5a40-4bf6-ac08-e92a63476717 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:15:59.529762 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6f78810c-5a40-4bf6-ac08-e92a63476717 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:00.445823 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-6f78810c-5a40-4bf6-ac08-e92a63476717 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "POST /compute/v2.1/servers/392749b4-22f6-470d-9b2e-4a9b2ded152b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.930901 Jul 21 20:16:00.446554 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 500/975] 10.222.0.58 () {60 vars in 1322 bytes} [Thu Jul 21 20:15:59 2022] POST /compute/v2.1/servers/392749b4-22f6-470d-9b2e-4a9b2ded152b/os-volume_attachments => generated 194 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:16:02.519789 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-d273fc8a-a4ff-4d8a-a95a-b0cbb0a3c866 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:16:02.520720 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-d273fc8a-a4ff-4d8a-a95a-b0cbb0a3c866 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: 5610f3fc-4e8b-48c0-a628-4b5c9419635a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:16:02.528045 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-d273fc8a-a4ff-4d8a-a95a-b0cbb0a3c866 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:02.528498 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-d273fc8a-a4ff-4d8a-a95a-b0cbb0a3c866 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:02.529272 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-d273fc8a-a4ff-4d8a-a95a-b0cbb0a3c866 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:02.529712 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-d273fc8a-a4ff-4d8a-a95a-b0cbb0a3c866 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:02.559181 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-d273fc8a-a4ff-4d8a-a95a-b0cbb0a3c866 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043353 Jul 21 20:16:02.559770 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 476/976] 10.222.0.58 () {60 vars in 1342 bytes} [Thu Jul 21 20:16:02 2022] GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:16:02.618532 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-2448b02b-efc5-4006-9ffb-6d7d556345b5 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:16:02.619139 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-2448b02b-efc5-4006-9ffb-6d7d556345b5 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: 5610f3fc-4e8b-48c0-a628-4b5c9419635a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:16:02.626130 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2448b02b-efc5-4006-9ffb-6d7d556345b5 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:02.626575 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2448b02b-efc5-4006-9ffb-6d7d556345b5 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:02.627376 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2448b02b-efc5-4006-9ffb-6d7d556345b5 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:02.627819 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2448b02b-efc5-4006-9ffb-6d7d556345b5 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:02.653964 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-2448b02b-efc5-4006-9ffb-6d7d556345b5 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: 5610f3fc-4e8b-48c0-a628-4b5c9419635a] Going to try to terminate instance {{(pid=118345) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 20:16:02.996861 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-2448b02b-efc5-4006-9ffb-6d7d556345b5 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "DELETE /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a" status: 204 len: 0 microversion: 2.20 time: 0.383023 Jul 21 20:16:02.997578 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 501/977] 10.222.0.58 () {60 vars in 1279 bytes} [Thu Jul 21 20:16:02 2022] DELETE /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a => generated 0 bytes in 385 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 21 20:16:03.006470 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-cf09c965-4cab-4b9c-aef8-461d800124a0 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:16:03.007294 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-cf09c965-4cab-4b9c-aef8-461d800124a0 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: 5610f3fc-4e8b-48c0-a628-4b5c9419635a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:16:03.013484 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-cf09c965-4cab-4b9c-aef8-461d800124a0 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:03.013937 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-cf09c965-4cab-4b9c-aef8-461d800124a0 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:03.014702 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-cf09c965-4cab-4b9c-aef8-461d800124a0 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:03.015169 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-cf09c965-4cab-4b9c-aef8-461d800124a0 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:03.410884 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-cf09c965-4cab-4b9c-aef8-461d800124a0 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:16:03.418980 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-cf09c965-4cab-4b9c-aef8-461d800124a0 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:16:03.420499 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-cf09c965-4cab-4b9c-aef8-461d800124a0 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:16:03.421681 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-cf09c965-4cab-4b9c-aef8-461d800124a0 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a" status: 200 len: 1724 microversion: 2.20 time: 0.419777 Jul 21 20:16:03.422401 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 477/978] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:16:03 2022] GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a => generated 1724 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:16:04.440585 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-33480c49-0c29-4f64-b359-33bcb7a247d8 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:16:04.441278 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-33480c49-0c29-4f64-b359-33bcb7a247d8 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: 5610f3fc-4e8b-48c0-a628-4b5c9419635a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:16:04.447559 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-33480c49-0c29-4f64-b359-33bcb7a247d8 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:04.447999 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-33480c49-0c29-4f64-b359-33bcb7a247d8 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:04.448760 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-33480c49-0c29-4f64-b359-33bcb7a247d8 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:04.449191 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-33480c49-0c29-4f64-b359-33bcb7a247d8 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:04.580136 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-33480c49-0c29-4f64-b359-33bcb7a247d8 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:16:04.588438 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-33480c49-0c29-4f64-b359-33bcb7a247d8 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:16:04.589941 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-33480c49-0c29-4f64-b359-33bcb7a247d8 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:16:04.591122 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-33480c49-0c29-4f64-b359-33bcb7a247d8 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a" status: 200 len: 1724 microversion: 2.20 time: 0.154814 Jul 21 20:16:04.591681 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 502/979] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:16:04 2022] GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 20:16:04.978858 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-58ead27c-cd43-44a9-8f3d-28857df7b997 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1315881911", "imageRef": "357a1479-6cbd-4882-8d3f-d945fa40e6df", "flavorRef": "452", "networks": [{"uuid": "e5121a6f-4921-46c5-948e-b10277e46b21"}]}} {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:16:05.031736 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.network.neutron [None req-58ead27c-cd43-44a9-8f3d-28857df7b997 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] validate_networks() for [('e5121a6f-4921-46c5-948e-b10277e46b21', None, None, None, None, None)] {{(pid=118344) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 20:16:05.609369 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-64bded3d-1128-4b92-a406-e4ca58213e6a tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:16:05.610075 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-64bded3d-1128-4b92-a406-e4ca58213e6a tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: 5610f3fc-4e8b-48c0-a628-4b5c9419635a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:16:05.617273 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-64bded3d-1128-4b92-a406-e4ca58213e6a tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:05.617851 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-64bded3d-1128-4b92-a406-e4ca58213e6a tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:05.618752 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-64bded3d-1128-4b92-a406-e4ca58213e6a tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:05.619213 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-64bded3d-1128-4b92-a406-e4ca58213e6a tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:05.752519 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.virt.hardware [None req-58ead27c-cd43-44a9-8f3d-28857df7b997 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Flavor limits 0:0:0 {{(pid=118344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 20:16:05.752680 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-64bded3d-1128-4b92-a406-e4ca58213e6a tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:16:05.753015 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.virt.hardware [None req-58ead27c-cd43-44a9-8f3d-28857df7b997 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Image limits 0:0:0 {{(pid=118344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 20:16:05.753549 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.virt.hardware [None req-58ead27c-cd43-44a9-8f3d-28857df7b997 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Flavor pref 0:0:0 {{(pid=118344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 20:16:05.754672 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.virt.hardware [None req-58ead27c-cd43-44a9-8f3d-28857df7b997 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Image pref 0:0:0 {{(pid=118344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 20:16:05.755173 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.virt.hardware [None req-58ead27c-cd43-44a9-8f3d-28857df7b997 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 20:16:05.761383 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-64bded3d-1128-4b92-a406-e4ca58213e6a tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:16:05.762884 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-64bded3d-1128-4b92-a406-e4ca58213e6a tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:16:05.764079 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-64bded3d-1128-4b92-a406-e4ca58213e6a tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a" status: 200 len: 1724 microversion: 2.20 time: 0.158592 Jul 21 20:16:05.767061 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 503/980] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:16:05 2022] GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 20:16:05.767215 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-58ead27c-cd43-44a9-8f3d-28857df7b997 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:05.767215 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-58ead27c-cd43-44a9-8f3d-28857df7b997 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:05.767215 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-58ead27c-cd43-44a9-8f3d-28857df7b997 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:05.767215 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-58ead27c-cd43-44a9-8f3d-28857df7b997 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:05.783476 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.quota [None req-58ead27c-cd43-44a9-8f3d-28857df7b997 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Getting quotas for project d7a0044f6e28474da9f3789f27654523. Resources: {'instances', 'cores', 'ram'} {{(pid=118344) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 20:16:05.787455 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.quota [None req-58ead27c-cd43-44a9-8f3d-28857df7b997 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Getting quotas for user 6329f88fae384f20ad2f6aa66dc9864f and project d7a0044f6e28474da9f3789f27654523. Resources: {'instances', 'cores', 'ram'} {{(pid=118344) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 20:16:05.798384 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-58ead27c-cd43-44a9-8f3d-28857df7b997 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Going to run 1 instances... {{(pid=118344) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 20:16:05.803840 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-58ead27c-cd43-44a9-8f3d-28857df7b997 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] [instance: 61231bf8-a454-4ae4-b94e-0193a0f45096] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='357a1479-6cbd-4882-8d3f-d945fa40e6df',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118344) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 20:16:05.958341 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-58ead27c-cd43-44a9-8f3d-28857df7b997 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.983418 Jul 21 20:16:05.959420 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 478/981] 10.222.0.58 () {60 vars in 1146 bytes} [Thu Jul 21 20:16:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 985 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 20:16:05.969228 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-a6d2085a-af7e-49ba-a9fa-23c149fce9d7 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:16:05.970031 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-a6d2085a-af7e-49ba-a9fa-23c149fce9d7 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] [instance: 61231bf8-a454-4ae4-b94e-0193a0f45096] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:16:06.029230 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-a6d2085a-af7e-49ba-a9fa-23c149fce9d7 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6329f88fae384f20ad2f6aa66dc9864f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a0044f6e28474da9f3789f27654523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:16:06.036912 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-a6d2085a-af7e-49ba-a9fa-23c149fce9d7 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] 10.222.0.58 "GET /compute/v2.1/servers/61231bf8-a454-4ae4-b94e-0193a0f45096" status: 200 len: 1214 microversion: 2.1 time: 0.071506 Jul 21 20:16:06.038100 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 504/982] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:16:05 2022] GET /compute/v2.1/servers/61231bf8-a454-4ae4-b94e-0193a0f45096 => generated 1214 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:16:06.267245 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [req-1241f563-b066-4903-a673-52f6f01a8f7d req-f7f1b107-15fc-49c2-b7b9-1d78ed8f1634 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5610f3fc-4e8b-48c0-a628-4b5c9419635a", "name": "network-vif-deleted", "tag": "c9b7a4f8-5df1-449c-9157-130a564accea"}]} {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:16:06.277445 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [req-1241f563-b066-4903-a673-52f6f01a8f7d req-f7f1b107-15fc-49c2-b7b9-1d78ed8f1634 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:06.281652 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [req-1241f563-b066-4903-a673-52f6f01a8f7d req-f7f1b107-15fc-49c2-b7b9-1d78ed8f1634 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:06.288651 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.compute.server_external_events [req-1241f563-b066-4903-a673-52f6f01a8f7d req-f7f1b107-15fc-49c2-b7b9-1d78ed8f1634 service nova] Creating event network-vif-deleted:c9b7a4f8-5df1-449c-9157-130a564accea for instance 5610f3fc-4e8b-48c0-a628-4b5c9419635a on hv-cinder-85054 Jul 21 20:16:06.294141 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [req-1241f563-b066-4903-a673-52f6f01a8f7d req-f7f1b107-15fc-49c2-b7b9-1d78ed8f1634 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031396 Jul 21 20:16:06.295468 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 479/983] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 20:16:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:16:06.781673 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-f3ad507e-e44b-46a0-b500-d1d56dc7c5c4 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:16:06.782277 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-f3ad507e-e44b-46a0-b500-d1d56dc7c5c4 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: 5610f3fc-4e8b-48c0-a628-4b5c9419635a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:16:06.789357 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f3ad507e-e44b-46a0-b500-d1d56dc7c5c4 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:06.789867 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f3ad507e-e44b-46a0-b500-d1d56dc7c5c4 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:06.790687 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f3ad507e-e44b-46a0-b500-d1d56dc7c5c4 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:06.791236 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f3ad507e-e44b-46a0-b500-d1d56dc7c5c4 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:06.822331 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f3ad507e-e44b-46a0-b500-d1d56dc7c5c4 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:06.822777 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f3ad507e-e44b-46a0-b500-d1d56dc7c5c4 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:06.823393 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.objects.instance [None req-f3ad507e-e44b-46a0-b500-d1d56dc7c5c4 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lazy-loading 'fault' on Instance uuid 5610f3fc-4e8b-48c0-a628-4b5c9419635a {{(pid=118345) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 20:16:06.864958 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-f3ad507e-e44b-46a0-b500-d1d56dc7c5c4 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:16:06.872828 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-f3ad507e-e44b-46a0-b500-d1d56dc7c5c4 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:16:06.874375 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-f3ad507e-e44b-46a0-b500-d1d56dc7c5c4 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:16:06.875553 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-f3ad507e-e44b-46a0-b500-d1d56dc7c5c4 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a" status: 200 len: 1372 microversion: 2.20 time: 0.097769 Jul 21 20:16:06.876108 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 505/984] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:16:06 2022] GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a => generated 1372 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:16:07.055177 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-b36d5284-2e48-4cfd-9e21-5cb2707caa6e tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:16:07.055930 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-b36d5284-2e48-4cfd-9e21-5cb2707caa6e tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] [instance: 61231bf8-a454-4ae4-b94e-0193a0f45096] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:16:07.062265 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-b36d5284-2e48-4cfd-9e21-5cb2707caa6e tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:07.062742 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-b36d5284-2e48-4cfd-9e21-5cb2707caa6e tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:07.063525 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-b36d5284-2e48-4cfd-9e21-5cb2707caa6e tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:07.063957 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-b36d5284-2e48-4cfd-9e21-5cb2707caa6e tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:07.128680 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-b36d5284-2e48-4cfd-9e21-5cb2707caa6e tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6329f88fae384f20ad2f6aa66dc9864f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a0044f6e28474da9f3789f27654523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:16:07.136280 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-b36d5284-2e48-4cfd-9e21-5cb2707caa6e tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] 10.222.0.58 "GET /compute/v2.1/servers/61231bf8-a454-4ae4-b94e-0193a0f45096" status: 200 len: 1218 microversion: 2.1 time: 0.085997 Jul 21 20:16:07.136840 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 480/985] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:16:07 2022] GET /compute/v2.1/servers/61231bf8-a454-4ae4-b94e-0193a0f45096 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:16:07.903401 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-d1ec004d-859c-4afd-af2d-5fd1c331ec0c tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:16:07.904129 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-d1ec004d-859c-4afd-af2d-5fd1c331ec0c tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: 5610f3fc-4e8b-48c0-a628-4b5c9419635a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:16:07.912021 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d1ec004d-859c-4afd-af2d-5fd1c331ec0c tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:07.912555 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d1ec004d-859c-4afd-af2d-5fd1c331ec0c tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:07.913516 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d1ec004d-859c-4afd-af2d-5fd1c331ec0c tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:07.914025 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d1ec004d-859c-4afd-af2d-5fd1c331ec0c tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:07.945644 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d1ec004d-859c-4afd-af2d-5fd1c331ec0c tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:07.946086 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d1ec004d-859c-4afd-af2d-5fd1c331ec0c tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:07.946529 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.objects.instance [None req-d1ec004d-859c-4afd-af2d-5fd1c331ec0c tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lazy-loading 'fault' on Instance uuid 5610f3fc-4e8b-48c0-a628-4b5c9419635a {{(pid=118345) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 20:16:07.992471 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-d1ec004d-859c-4afd-af2d-5fd1c331ec0c tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:16:08.000469 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-d1ec004d-859c-4afd-af2d-5fd1c331ec0c tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:16:08.001970 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-d1ec004d-859c-4afd-af2d-5fd1c331ec0c tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02a93000972547d08f11f7ed23264d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece8b465c04d33998002f8d880d556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:16:08.003135 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-d1ec004d-859c-4afd-af2d-5fd1c331ec0c tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a" status: 200 len: 1372 microversion: 2.20 time: 0.103968 Jul 21 20:16:08.003754 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 506/986] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:16:07 2022] GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a => generated 1372 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:16:08.152388 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-b1472aba-076d-440a-b96b-1e50242e0f90 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:16:08.153029 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-b1472aba-076d-440a-b96b-1e50242e0f90 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] [instance: 61231bf8-a454-4ae4-b94e-0193a0f45096] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:16:08.159776 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-b1472aba-076d-440a-b96b-1e50242e0f90 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:08.160186 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-b1472aba-076d-440a-b96b-1e50242e0f90 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:08.160986 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-b1472aba-076d-440a-b96b-1e50242e0f90 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:08.161511 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-b1472aba-076d-440a-b96b-1e50242e0f90 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:08.223808 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-b1472aba-076d-440a-b96b-1e50242e0f90 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6329f88fae384f20ad2f6aa66dc9864f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a0044f6e28474da9f3789f27654523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:16:08.235928 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-b1472aba-076d-440a-b96b-1e50242e0f90 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] 10.222.0.58 "GET /compute/v2.1/servers/61231bf8-a454-4ae4-b94e-0193a0f45096" status: 200 len: 1266 microversion: 2.1 time: 0.082670 Jul 21 20:16:08.235928 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 481/987] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:16:08 2022] GET /compute/v2.1/servers/61231bf8-a454-4ae4-b94e-0193a0f45096 => generated 1266 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:16:09.022525 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-29acbb4a-f107-44c9-8f93-fbbc55adc935 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:16:09.022924 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-29acbb4a-f107-44c9-8f93-fbbc55adc935 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: 5610f3fc-4e8b-48c0-a628-4b5c9419635a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:16:09.029142 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-29acbb4a-f107-44c9-8f93-fbbc55adc935 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:09.029589 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-29acbb4a-f107-44c9-8f93-fbbc55adc935 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:09.030394 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-29acbb4a-f107-44c9-8f93-fbbc55adc935 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:09.030826 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-29acbb4a-f107-44c9-8f93-fbbc55adc935 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:09.044921 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.wsgi [None req-29acbb4a-f107-44c9-8f93-fbbc55adc935 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] HTTP exception thrown: Instance 5610f3fc-4e8b-48c0-a628-4b5c9419635a could not be found. Jul 21 20:16:09.046631 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-29acbb4a-f107-44c9-8f93-fbbc55adc935 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Request method failure captured: Jul 21 20:16:09.046631 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: request: GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a HTTP/1.1 Jul 21 20:16:09.046631 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Accept: application/json Jul 21 20:16:09.046631 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Accept-Encoding: identity Jul 21 20:16:09.046631 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Connection: close Jul 21 20:16:09.046631 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Content-Length: 0 Jul 21 20:16:09.046631 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Content-Type: application/json Jul 21 20:16:09.046631 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Host: 10.222.0.58 Jul 21 20:16:09.046631 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Openstack-System-Scope: None Jul 21 20:16:09.046631 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: User-Agent: python-urllib3/1.26.9 Jul 21 20:16:09.046631 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Auth-Token: gAAAAABi2bFmVNxr-PjOOkcTeCXQJ6pQ_y2iOz5ylVO9d7XyC54olaVFhrXWlH2Nketcv2tpxKRFAlpWv7eWy5Dm8T4JnG-iEELS8i5qTa4gA2jB410pUUqzV0CkFgwjk5v525thD23F61IAu7zoqYCKTp1dPl4sdyVA9Xz0i2zTX9M2Fj9lwR0 Jul 21 20:16:09.046631 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Domain-Id: None Jul 21 20:16:09.046631 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Domain-Name: None Jul 21 20:16:09.046631 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Identity-Status: Confirmed Jul 21 20:16:09.046631 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Is-Admin-Project: True Jul 21 20:16:09.046631 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Openstack-Nova-Api-Version: 2.20 Jul 21 20:16:09.046631 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Id: default Jul 21 20:16:09.046631 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Name: Default Jul 21 20:16:09.046631 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Id: f8ece8b465c04d33998002f8d880d556 Jul 21 20:16:09.046631 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1726184728 Jul 21 20:16:09.046631 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Role: reader,member Jul 21 20:16:09.046631 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Roles: reader,member Jul 21 20:16:09.048310 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f8ece8b465c04d33998002f8d880d556"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f8ece8b465c04d33998002f8d880d556"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f8ece8b465c04d33998002f8d880d556"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f8ece8b465c04d33998002f8d880d556"}]}] Jul 21 20:16:09.048310 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1726184728 Jul 21 20:16:09.048310 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Tenant-Id: f8ece8b465c04d33998002f8d880d556 Jul 21 20:16:09.048310 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1726184728 Jul 21 20:16:09.048310 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User: tempest-AttachVolumeShelveTestJSON-1726184728-project Jul 21 20:16:09.048310 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Id: default Jul 21 20:16:09.048310 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Name: Default Jul 21 20:16:09.048310 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Id: 02a93000972547d08f11f7ed23264d31 Jul 21 20:16:09.048310 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1726184728-project Jul 21 20:16:09.048310 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: method: > Jul 21 20:16:09.048310 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: exception: Instance 5610f3fc-4e8b-48c0-a628-4b5c9419635a could not be found. Jul 21 20:16:09.048310 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: action_args: {'id': '5610f3fc-4e8b-48c0-a628-4b5c9419635a'} Jul 21 20:16:09.049393 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 20:16:09.049393 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:16:09.049393 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 20:16:09.049393 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 20:16:09.049393 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 20:16:09.049393 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 20:16:09.049393 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 20:16:09.049393 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 20:16:09.049393 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 20:16:09.049393 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 20:16:09.049393 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5610f3fc-4e8b-48c0-a628-4b5c9419635a could not be found. Jul 21 20:16:09.049393 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:16:09.049393 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:16:09.049393 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:16:09.049393 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:16:09.049393 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:16:09.049393 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:16:09.049393 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 20:16:09.049393 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 20:16:09.049393 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 20:16:09.050663 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 20:16:09.050663 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 20:16:09.050663 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 20:16:09.050663 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 20:16:09.050663 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 20:16:09.050663 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 20:16:09.050663 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 20:16:09.050663 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5610f3fc-4e8b-48c0-a628-4b5c9419635a could not be found. Jul 21 20:16:09.050663 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:16:09.050663 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:16:09.050663 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:16:09.050663 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:16:09.050663 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:16:09.050663 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:16:09.050663 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 20:16:09.050663 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 20:16:09.050663 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5610f3fc-4e8b-48c0-a628-4b5c9419635a could not be found. Jul 21 20:16:09.050663 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:16:09.052769 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-29acbb4a-f107-44c9-8f93-fbbc55adc935 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Returning 404 to user: Instance 5610f3fc-4e8b-48c0-a628-4b5c9419635a could not be found. {{(pid=118345) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 20:16:09.052769 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-29acbb4a-f107-44c9-8f93-fbbc55adc935 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a" status: 404 len: 111 microversion: 2.20 time: 0.030246 Jul 21 20:16:09.052769 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 507/988] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:16:09 2022] GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 21 20:16:09.057209 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-fb40d3e7-64be-4fbd-b9f2-d0de9586352e tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '.version_select at 0x7f351cae64c0>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:16:09.116466 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-fb40d3e7-64be-4fbd-b9f2-d0de9586352e tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1778725212" status: 204 len: 0 microversion: 2.20 time: 0.063079 Jul 21 20:16:09.117317 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 482/989] 10.222.0.58 () {60 vars in 1261 bytes} [Thu Jul 21 20:16:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1778725212 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 21 20:16:09.249159 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-259f0616-2f42-485d-9688-fe5ae1a97b66 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:16:09.250077 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-259f0616-2f42-485d-9688-fe5ae1a97b66 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] [instance: 61231bf8-a454-4ae4-b94e-0193a0f45096] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:16:09.257523 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-259f0616-2f42-485d-9688-fe5ae1a97b66 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:09.258337 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-259f0616-2f42-485d-9688-fe5ae1a97b66 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:09.259312 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-259f0616-2f42-485d-9688-fe5ae1a97b66 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:09.259950 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-259f0616-2f42-485d-9688-fe5ae1a97b66 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:09.349343 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-8a4f0433-da10-40f1-9f50-00a861ecdef4 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:16:09.352249 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-8a4f0433-da10-40f1-9f50-00a861ecdef4 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 392749b4-22f6-470d-9b2e-4a9b2ded152b] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:16:09.367416 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-8a4f0433-da10-40f1-9f50-00a861ecdef4 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:09.369972 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-8a4f0433-da10-40f1-9f50-00a861ecdef4 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:09.370797 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-8a4f0433-da10-40f1-9f50-00a861ecdef4 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:09.371279 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-8a4f0433-da10-40f1-9f50-00a861ecdef4 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:09.476296 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.objects.instance [None req-8a4f0433-da10-40f1-9f50-00a861ecdef4 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lazy-loading 'services' on Instance uuid 392749b4-22f6-470d-9b2e-4a9b2ded152b {{(pid=118344) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 20:16:09.482983 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-259f0616-2f42-485d-9688-fe5ae1a97b66 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6329f88fae384f20ad2f6aa66dc9864f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a0044f6e28474da9f3789f27654523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:16:09.490485 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-259f0616-2f42-485d-9688-fe5ae1a97b66 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] 10.222.0.58 "GET /compute/v2.1/servers/61231bf8-a454-4ae4-b94e-0193a0f45096" status: 200 len: 1314 microversion: 2.1 time: 0.246003 Jul 21 20:16:09.491076 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 508/990] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:16:09 2022] GET /compute/v2.1/servers/61231bf8-a454-4ae4-b94e-0193a0f45096 => generated 1314 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:16:09.745039 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-8a4f0433-da10-40f1-9f50-00a861ecdef4 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "DELETE /compute/v2.1/servers/392749b4-22f6-470d-9b2e-4a9b2ded152b/os-volume_attachments/e4a9d759-f3ad-400c-9c80-b103ce1caead" status: 202 len: 0 microversion: 2.1 time: 0.410079 Jul 21 20:16:09.746278 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 483/991] 10.222.0.58 () {58 vars in 1415 bytes} [Thu Jul 21 20:16:09 2022] DELETE /compute/v2.1/servers/392749b4-22f6-470d-9b2e-4a9b2ded152b/os-volume_attachments/e4a9d759-f3ad-400c-9c80-b103ce1caead => generated 0 bytes in 413 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 21 20:16:09.757429 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-8fcdfa29-778e-4883-bb0c-152c6df9ea51 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:16:09.758812 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-8fcdfa29-778e-4883-bb0c-152c6df9ea51 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 392749b4-22f6-470d-9b2e-4a9b2ded152b] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:16:09.765465 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8fcdfa29-778e-4883-bb0c-152c6df9ea51 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:09.765911 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8fcdfa29-778e-4883-bb0c-152c6df9ea51 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:09.766898 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8fcdfa29-778e-4883-bb0c-152c6df9ea51 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:09.767365 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8fcdfa29-778e-4883-bb0c-152c6df9ea51 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:09.800247 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-8fcdfa29-778e-4883-bb0c-152c6df9ea51 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/392749b4-22f6-470d-9b2e-4a9b2ded152b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047112 Jul 21 20:16:09.800807 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 509/992] 10.222.0.58 () {58 vars in 1301 bytes} [Thu Jul 21 20:16:09 2022] GET /compute/v2.1/servers/392749b4-22f6-470d-9b2e-4a9b2ded152b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:16:10.343946 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [req-0106dd0c-c59e-4bd3-9279-5e62448b67e9 req-f9ebf9da-dcf3-42dd-9716-df2557064819 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61231bf8-a454-4ae4-b94e-0193a0f45096", "tag": "b7d66ba5-3ef5-4913-a529-1308eabeee5e"}]} {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:16:10.354725 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [req-0106dd0c-c59e-4bd3-9279-5e62448b67e9 req-f9ebf9da-dcf3-42dd-9716-df2557064819 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:10.355381 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [req-0106dd0c-c59e-4bd3-9279-5e62448b67e9 req-f9ebf9da-dcf3-42dd-9716-df2557064819 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:10.367075 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.compute.server_external_events [req-0106dd0c-c59e-4bd3-9279-5e62448b67e9 req-f9ebf9da-dcf3-42dd-9716-df2557064819 service nova] Creating event network-changed:b7d66ba5-3ef5-4913-a529-1308eabeee5e for instance 61231bf8-a454-4ae4-b94e-0193a0f45096 on hv-cinder-85054 Jul 21 20:16:10.371814 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [req-0106dd0c-c59e-4bd3-9279-5e62448b67e9 req-f9ebf9da-dcf3-42dd-9716-df2557064819 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032712 Jul 21 20:16:10.372403 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 484/993] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 20:16:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:16:10.508105 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-24fa6263-fc95-4a3b-a22a-7efc21f03f0c tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:16:10.508812 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-24fa6263-fc95-4a3b-a22a-7efc21f03f0c tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] [instance: 61231bf8-a454-4ae4-b94e-0193a0f45096] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:16:10.515303 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-24fa6263-fc95-4a3b-a22a-7efc21f03f0c tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:10.515739 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-24fa6263-fc95-4a3b-a22a-7efc21f03f0c tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:10.516521 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-24fa6263-fc95-4a3b-a22a-7efc21f03f0c tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:10.516944 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-24fa6263-fc95-4a3b-a22a-7efc21f03f0c tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:10.661644 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-24fa6263-fc95-4a3b-a22a-7efc21f03f0c tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6329f88fae384f20ad2f6aa66dc9864f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a0044f6e28474da9f3789f27654523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:16:10.668915 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-24fa6263-fc95-4a3b-a22a-7efc21f03f0c tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] 10.222.0.58 "GET /compute/v2.1/servers/61231bf8-a454-4ae4-b94e-0193a0f45096" status: 200 len: 1314 microversion: 2.1 time: 0.165270 Jul 21 20:16:10.669465 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 510/994] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:16:10 2022] GET /compute/v2.1/servers/61231bf8-a454-4ae4-b94e-0193a0f45096 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:16:10.813359 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-772a5c86-7ddd-42ea-a527-f80a877ecaeb tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:16:10.814348 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-772a5c86-7ddd-42ea-a527-f80a877ecaeb tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 392749b4-22f6-470d-9b2e-4a9b2ded152b] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:16:10.821150 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-772a5c86-7ddd-42ea-a527-f80a877ecaeb tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:10.821610 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-772a5c86-7ddd-42ea-a527-f80a877ecaeb tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:10.822400 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-772a5c86-7ddd-42ea-a527-f80a877ecaeb tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:10.822834 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-772a5c86-7ddd-42ea-a527-f80a877ecaeb tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:10.854854 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-772a5c86-7ddd-42ea-a527-f80a877ecaeb tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/392749b4-22f6-470d-9b2e-4a9b2ded152b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046022 Jul 21 20:16:10.855652 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 485/995] 10.222.0.58 () {58 vars in 1301 bytes} [Thu Jul 21 20:16:10 2022] GET /compute/v2.1/servers/392749b4-22f6-470d-9b2e-4a9b2ded152b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:16:11.238477 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-82c86acb-ee30-495e-90e6-6930c9000f79 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:16:11.247394 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-82c86acb-ee30-495e-90e6-6930c9000f79 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: 5610f3fc-4e8b-48c0-a628-4b5c9419635a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:16:11.247394 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-82c86acb-ee30-495e-90e6-6930c9000f79 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:11.247394 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-82c86acb-ee30-495e-90e6-6930c9000f79 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:11.247394 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-82c86acb-ee30-495e-90e6-6930c9000f79 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:11.247775 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-82c86acb-ee30-495e-90e6-6930c9000f79 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:11.260592 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.wsgi [None req-82c86acb-ee30-495e-90e6-6930c9000f79 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] HTTP exception thrown: Instance 5610f3fc-4e8b-48c0-a628-4b5c9419635a could not be found. Jul 21 20:16:11.262166 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-82c86acb-ee30-495e-90e6-6930c9000f79 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Request method failure captured: Jul 21 20:16:11.262166 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: request: DELETE /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a HTTP/1.1 Jul 21 20:16:11.262166 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Accept: application/json Jul 21 20:16:11.262166 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Accept-Encoding: identity Jul 21 20:16:11.262166 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Connection: close Jul 21 20:16:11.262166 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Content-Length: 0 Jul 21 20:16:11.262166 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Content-Type: application/json Jul 21 20:16:11.262166 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Host: 10.222.0.58 Jul 21 20:16:11.262166 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Openstack-System-Scope: None Jul 21 20:16:11.262166 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: User-Agent: python-urllib3/1.26.9 Jul 21 20:16:11.262166 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Auth-Token: gAAAAABi2bFmVNxr-PjOOkcTeCXQJ6pQ_y2iOz5ylVO9d7XyC54olaVFhrXWlH2Nketcv2tpxKRFAlpWv7eWy5Dm8T4JnG-iEELS8i5qTa4gA2jB410pUUqzV0CkFgwjk5v525thD23F61IAu7zoqYCKTp1dPl4sdyVA9Xz0i2zTX9M2Fj9lwR0 Jul 21 20:16:11.262166 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Domain-Id: None Jul 21 20:16:11.262166 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Domain-Name: None Jul 21 20:16:11.262166 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Identity-Status: Confirmed Jul 21 20:16:11.262166 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Is-Admin-Project: True Jul 21 20:16:11.262166 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Openstack-Nova-Api-Version: 2.20 Jul 21 20:16:11.262166 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Id: default Jul 21 20:16:11.262166 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Name: Default Jul 21 20:16:11.262166 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Id: f8ece8b465c04d33998002f8d880d556 Jul 21 20:16:11.262166 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1726184728 Jul 21 20:16:11.262166 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Role: reader,member Jul 21 20:16:11.262166 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Roles: reader,member Jul 21 20:16:11.263742 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f8ece8b465c04d33998002f8d880d556"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f8ece8b465c04d33998002f8d880d556"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f8ece8b465c04d33998002f8d880d556"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f8ece8b465c04d33998002f8d880d556"}]}] Jul 21 20:16:11.263742 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1726184728 Jul 21 20:16:11.263742 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Tenant-Id: f8ece8b465c04d33998002f8d880d556 Jul 21 20:16:11.263742 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1726184728 Jul 21 20:16:11.263742 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User: tempest-AttachVolumeShelveTestJSON-1726184728-project Jul 21 20:16:11.263742 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Id: default Jul 21 20:16:11.263742 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Name: Default Jul 21 20:16:11.263742 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Id: 02a93000972547d08f11f7ed23264d31 Jul 21 20:16:11.263742 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1726184728-project Jul 21 20:16:11.263742 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: method: > Jul 21 20:16:11.263742 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: exception: Instance 5610f3fc-4e8b-48c0-a628-4b5c9419635a could not be found. Jul 21 20:16:11.263742 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: action_args: {'id': '5610f3fc-4e8b-48c0-a628-4b5c9419635a'} Jul 21 20:16:11.264591 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 20:16:11.264591 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:16:11.264591 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 20:16:11.264591 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 20:16:11.264591 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 20:16:11.264591 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 20:16:11.264591 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 20:16:11.264591 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 20:16:11.264591 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 20:16:11.264591 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 20:16:11.264591 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5610f3fc-4e8b-48c0-a628-4b5c9419635a could not be found. Jul 21 20:16:11.264591 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:16:11.264591 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:16:11.264591 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:16:11.264591 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:16:11.264591 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:16:11.264591 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:16:11.264591 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 20:16:11.264591 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 20:16:11.264591 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 20:16:11.266073 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 20:16:11.266073 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 20:16:11.266073 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 20:16:11.266073 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 20:16:11.266073 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 20:16:11.266073 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 20:16:11.266073 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 20:16:11.266073 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 20:16:11.266073 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 20:16:11.266073 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5610f3fc-4e8b-48c0-a628-4b5c9419635a could not be found. Jul 21 20:16:11.266073 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:16:11.266073 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:16:11.266073 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:16:11.266073 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:16:11.266073 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:16:11.266073 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:16:11.266073 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 20:16:11.266073 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 20:16:11.266073 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5610f3fc-4e8b-48c0-a628-4b5c9419635a could not be found. Jul 21 20:16:11.266073 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:16:11.267556 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-82c86acb-ee30-495e-90e6-6930c9000f79 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Returning 404 to user: Instance 5610f3fc-4e8b-48c0-a628-4b5c9419635a could not be found. {{(pid=118345) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 20:16:11.267556 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-82c86acb-ee30-495e-90e6-6930c9000f79 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "DELETE /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a" status: 404 len: 111 microversion: 2.20 time: 0.029034 Jul 21 20:16:11.267556 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 511/996] 10.222.0.58 () {60 vars in 1279 bytes} [Thu Jul 21 20:16:11 2022] DELETE /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 21 20:16:11.271970 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-92750bdc-2de1-4e17-a2b0-ded3469e842f tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:16:11.272572 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-92750bdc-2de1-4e17-a2b0-ded3469e842f tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: 5610f3fc-4e8b-48c0-a628-4b5c9419635a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:16:11.278560 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-92750bdc-2de1-4e17-a2b0-ded3469e842f tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:11.279001 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-92750bdc-2de1-4e17-a2b0-ded3469e842f tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:11.279784 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-92750bdc-2de1-4e17-a2b0-ded3469e842f tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:11.280217 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-92750bdc-2de1-4e17-a2b0-ded3469e842f tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:11.293794 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.wsgi [None req-92750bdc-2de1-4e17-a2b0-ded3469e842f tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] HTTP exception thrown: Instance 5610f3fc-4e8b-48c0-a628-4b5c9419635a could not be found. Jul 21 20:16:11.295464 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-92750bdc-2de1-4e17-a2b0-ded3469e842f tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Request method failure captured: Jul 21 20:16:11.295464 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: request: GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a HTTP/1.1 Jul 21 20:16:11.295464 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Accept: application/json Jul 21 20:16:11.295464 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Accept-Encoding: identity Jul 21 20:16:11.295464 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Connection: close Jul 21 20:16:11.295464 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Content-Length: 0 Jul 21 20:16:11.295464 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Content-Type: application/json Jul 21 20:16:11.295464 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Host: 10.222.0.58 Jul 21 20:16:11.295464 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Openstack-System-Scope: None Jul 21 20:16:11.295464 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: User-Agent: python-urllib3/1.26.9 Jul 21 20:16:11.295464 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Auth-Token: gAAAAABi2bFmVNxr-PjOOkcTeCXQJ6pQ_y2iOz5ylVO9d7XyC54olaVFhrXWlH2Nketcv2tpxKRFAlpWv7eWy5Dm8T4JnG-iEELS8i5qTa4gA2jB410pUUqzV0CkFgwjk5v525thD23F61IAu7zoqYCKTp1dPl4sdyVA9Xz0i2zTX9M2Fj9lwR0 Jul 21 20:16:11.295464 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Domain-Id: None Jul 21 20:16:11.295464 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Domain-Name: None Jul 21 20:16:11.295464 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Identity-Status: Confirmed Jul 21 20:16:11.295464 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Is-Admin-Project: True Jul 21 20:16:11.295464 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Openstack-Nova-Api-Version: 2.20 Jul 21 20:16:11.295464 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Domain-Id: default Jul 21 20:16:11.295464 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Domain-Name: Default Jul 21 20:16:11.295464 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Id: f8ece8b465c04d33998002f8d880d556 Jul 21 20:16:11.295464 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1726184728 Jul 21 20:16:11.295464 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Role: reader,member Jul 21 20:16:11.295464 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Roles: reader,member Jul 21 20:16:11.297161 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f8ece8b465c04d33998002f8d880d556"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f8ece8b465c04d33998002f8d880d556"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f8ece8b465c04d33998002f8d880d556"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f8ece8b465c04d33998002f8d880d556"}]}] Jul 21 20:16:11.297161 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1726184728 Jul 21 20:16:11.297161 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Tenant-Id: f8ece8b465c04d33998002f8d880d556 Jul 21 20:16:11.297161 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1726184728 Jul 21 20:16:11.297161 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User: tempest-AttachVolumeShelveTestJSON-1726184728-project Jul 21 20:16:11.297161 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Domain-Id: default Jul 21 20:16:11.297161 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Domain-Name: Default Jul 21 20:16:11.297161 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Id: 02a93000972547d08f11f7ed23264d31 Jul 21 20:16:11.297161 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1726184728-project Jul 21 20:16:11.297161 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: method: > Jul 21 20:16:11.297161 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: exception: Instance 5610f3fc-4e8b-48c0-a628-4b5c9419635a could not be found. Jul 21 20:16:11.297161 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: action_args: {'id': '5610f3fc-4e8b-48c0-a628-4b5c9419635a'} Jul 21 20:16:11.298049 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 20:16:11.298049 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:16:11.298049 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 20:16:11.298049 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 20:16:11.298049 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 20:16:11.298049 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 20:16:11.298049 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 20:16:11.298049 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 20:16:11.298049 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 20:16:11.298049 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 20:16:11.298049 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5610f3fc-4e8b-48c0-a628-4b5c9419635a could not be found. Jul 21 20:16:11.298049 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:16:11.298049 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:16:11.298049 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:16:11.298049 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:16:11.298049 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:16:11.298049 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:16:11.298049 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 20:16:11.298049 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 20:16:11.298049 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 20:16:11.299973 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 20:16:11.299973 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 20:16:11.299973 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 20:16:11.299973 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 20:16:11.299973 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 20:16:11.299973 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 20:16:11.299973 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 20:16:11.299973 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5610f3fc-4e8b-48c0-a628-4b5c9419635a could not be found. Jul 21 20:16:11.299973 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:16:11.299973 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:16:11.299973 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:16:11.299973 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:16:11.299973 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:16:11.299973 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:16:11.299973 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 20:16:11.299973 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 20:16:11.299973 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5610f3fc-4e8b-48c0-a628-4b5c9419635a could not be found. Jul 21 20:16:11.299973 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:16:11.301257 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-92750bdc-2de1-4e17-a2b0-ded3469e842f tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Returning 404 to user: Instance 5610f3fc-4e8b-48c0-a628-4b5c9419635a could not be found. {{(pid=118344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 20:16:11.301257 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-92750bdc-2de1-4e17-a2b0-ded3469e842f tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a" status: 404 len: 111 microversion: 2.20 time: 0.028677 Jul 21 20:16:11.301257 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 486/997] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:16:11 2022] GET /compute/v2.1/servers/5610f3fc-4e8b-48c0-a628-4b5c9419635a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 21 20:16:11.685733 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-81a2e16f-08f9-4bb5-aa12-f1e708ba0f60 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:16:11.686339 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-81a2e16f-08f9-4bb5-aa12-f1e708ba0f60 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] [instance: 61231bf8-a454-4ae4-b94e-0193a0f45096] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:16:11.693420 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-81a2e16f-08f9-4bb5-aa12-f1e708ba0f60 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:11.698272 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-81a2e16f-08f9-4bb5-aa12-f1e708ba0f60 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:11.698272 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-81a2e16f-08f9-4bb5-aa12-f1e708ba0f60 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:11.698272 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-81a2e16f-08f9-4bb5-aa12-f1e708ba0f60 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:11.826636 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-81a2e16f-08f9-4bb5-aa12-f1e708ba0f60 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6329f88fae384f20ad2f6aa66dc9864f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a0044f6e28474da9f3789f27654523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:16:11.834068 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-81a2e16f-08f9-4bb5-aa12-f1e708ba0f60 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] 10.222.0.58 "GET /compute/v2.1/servers/61231bf8-a454-4ae4-b94e-0193a0f45096" status: 200 len: 1314 microversion: 2.1 time: 0.152308 Jul 21 20:16:11.834631 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 512/998] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:16:11 2022] GET /compute/v2.1/servers/61231bf8-a454-4ae4-b94e-0193a0f45096 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:16:11.866201 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-e0435c00-c9db-4724-869c-c6a53395a832 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:16:11.867159 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-e0435c00-c9db-4724-869c-c6a53395a832 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 392749b4-22f6-470d-9b2e-4a9b2ded152b] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:16:11.873590 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-e0435c00-c9db-4724-869c-c6a53395a832 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:11.874039 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-e0435c00-c9db-4724-869c-c6a53395a832 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:11.874805 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-e0435c00-c9db-4724-869c-c6a53395a832 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:11.875272 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-e0435c00-c9db-4724-869c-c6a53395a832 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:11.904175 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-e0435c00-c9db-4724-869c-c6a53395a832 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/392749b4-22f6-470d-9b2e-4a9b2ded152b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042338 Jul 21 20:16:11.904645 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 487/999] 10.222.0.58 () {58 vars in 1301 bytes} [Thu Jul 21 20:16:11 2022] GET /compute/v2.1/servers/392749b4-22f6-470d-9b2e-4a9b2ded152b/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 21 20:16:11.965685 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-babe7737-e90b-4b98-8d34-18473acf4e06 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:16:11.966180 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-babe7737-e90b-4b98-8d34-18473acf4e06 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 392749b4-22f6-470d-9b2e-4a9b2ded152b] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:16:11.972367 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-babe7737-e90b-4b98-8d34-18473acf4e06 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:11.972817 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-babe7737-e90b-4b98-8d34-18473acf4e06 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:11.974118 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-babe7737-e90b-4b98-8d34-18473acf4e06 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:11.974558 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-babe7737-e90b-4b98-8d34-18473acf4e06 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:11.998706 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-babe7737-e90b-4b98-8d34-18473acf4e06 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 392749b4-22f6-470d-9b2e-4a9b2ded152b] Going to try to terminate instance {{(pid=118345) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 20:16:12.137880 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:16:12.344365 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-babe7737-e90b-4b98-8d34-18473acf4e06 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "DELETE /compute/v2.1/servers/392749b4-22f6-470d-9b2e-4a9b2ded152b" status: 204 len: 0 microversion: 2.1 time: 0.382183 Jul 21 20:16:12.345030 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 513/1000] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Jul 21 20:16:11 2022] DELETE /compute/v2.1/servers/392749b4-22f6-470d-9b2e-4a9b2ded152b => generated 0 bytes in 384 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 20:16:12.353592 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-6b1e3f7e-3dba-47c0-93c9-2fe20b62f643 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:16:12.354389 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-6b1e3f7e-3dba-47c0-93c9-2fe20b62f643 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 392749b4-22f6-470d-9b2e-4a9b2ded152b] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:16:12.360432 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-6b1e3f7e-3dba-47c0-93c9-2fe20b62f643 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:12.360875 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-6b1e3f7e-3dba-47c0-93c9-2fe20b62f643 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:12.361630 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-6b1e3f7e-3dba-47c0-93c9-2fe20b62f643 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:12.362062 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-6b1e3f7e-3dba-47c0-93c9-2fe20b62f643 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:12.494629 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-6b1e3f7e-3dba-47c0-93c9-2fe20b62f643 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:16:12.502159 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-6b1e3f7e-3dba-47c0-93c9-2fe20b62f643 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/392749b4-22f6-470d-9b2e-4a9b2ded152b" status: 200 len: 1682 microversion: 2.1 time: 0.152375 Jul 21 20:16:12.502659 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 488/1001] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:16:12 2022] GET /compute/v2.1/servers/392749b4-22f6-470d-9b2e-4a9b2ded152b => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:16:12.578444 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-af3e6bd4-f395-428b-8ec0-fb82839ab0c0 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:16:12.579047 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-af3e6bd4-f395-428b-8ec0-fb82839ab0c0 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:16:12.584985 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-af3e6bd4-f395-428b-8ec0-fb82839ab0c0 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:12.585422 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-af3e6bd4-f395-428b-8ec0-fb82839ab0c0 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:12.586176 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-af3e6bd4-f395-428b-8ec0-fb82839ab0c0 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:12.586606 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-af3e6bd4-f395-428b-8ec0-fb82839ab0c0 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:12.599821 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.wsgi [None req-af3e6bd4-f395-428b-8ec0-fb82839ab0c0 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] HTTP exception thrown: Instance b07e385b-3d8f-4370-a8fc-013a1c785c0f could not be found. Jul 21 20:16:12.601434 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-af3e6bd4-f395-428b-8ec0-fb82839ab0c0 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Request method failure captured: Jul 21 20:16:12.601434 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: request: DELETE /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f HTTP/1.1 Jul 21 20:16:12.601434 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Accept: application/json Jul 21 20:16:12.601434 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Accept-Encoding: identity Jul 21 20:16:12.601434 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Connection: close Jul 21 20:16:12.601434 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Content-Length: 0 Jul 21 20:16:12.601434 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Content-Type: application/json Jul 21 20:16:12.601434 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Host: 10.222.0.58 Jul 21 20:16:12.601434 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Openstack-System-Scope: None Jul 21 20:16:12.601434 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: User-Agent: python-urllib3/1.26.9 Jul 21 20:16:12.601434 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Auth-Token: gAAAAABi2bFmVNxr-PjOOkcTeCXQJ6pQ_y2iOz5ylVO9d7XyC54olaVFhrXWlH2Nketcv2tpxKRFAlpWv7eWy5Dm8T4JnG-iEELS8i5qTa4gA2jB410pUUqzV0CkFgwjk5v525thD23F61IAu7zoqYCKTp1dPl4sdyVA9Xz0i2zTX9M2Fj9lwR0 Jul 21 20:16:12.601434 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Domain-Id: None Jul 21 20:16:12.601434 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Domain-Name: None Jul 21 20:16:12.601434 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Identity-Status: Confirmed Jul 21 20:16:12.601434 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Is-Admin-Project: True Jul 21 20:16:12.601434 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Openstack-Nova-Api-Version: 2.20 Jul 21 20:16:12.601434 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Id: default Jul 21 20:16:12.601434 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Name: Default Jul 21 20:16:12.601434 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Id: f8ece8b465c04d33998002f8d880d556 Jul 21 20:16:12.601434 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1726184728 Jul 21 20:16:12.601434 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Role: reader,member Jul 21 20:16:12.601434 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Roles: reader,member Jul 21 20:16:12.602998 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f8ece8b465c04d33998002f8d880d556"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f8ece8b465c04d33998002f8d880d556"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f8ece8b465c04d33998002f8d880d556"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f8ece8b465c04d33998002f8d880d556"}]}] Jul 21 20:16:12.602998 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1726184728 Jul 21 20:16:12.602998 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Tenant-Id: f8ece8b465c04d33998002f8d880d556 Jul 21 20:16:12.602998 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1726184728 Jul 21 20:16:12.602998 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User: tempest-AttachVolumeShelveTestJSON-1726184728-project Jul 21 20:16:12.602998 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Id: default Jul 21 20:16:12.602998 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Name: Default Jul 21 20:16:12.602998 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Id: 02a93000972547d08f11f7ed23264d31 Jul 21 20:16:12.602998 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1726184728-project Jul 21 20:16:12.602998 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: method: > Jul 21 20:16:12.602998 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: exception: Instance b07e385b-3d8f-4370-a8fc-013a1c785c0f could not be found. Jul 21 20:16:12.602998 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: action_args: {'id': 'b07e385b-3d8f-4370-a8fc-013a1c785c0f'} Jul 21 20:16:12.603974 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 20:16:12.603974 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:16:12.603974 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 20:16:12.603974 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 20:16:12.603974 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 20:16:12.603974 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 20:16:12.603974 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 20:16:12.603974 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 20:16:12.603974 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 20:16:12.603974 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 20:16:12.603974 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b07e385b-3d8f-4370-a8fc-013a1c785c0f could not be found. Jul 21 20:16:12.603974 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:16:12.603974 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:16:12.603974 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:16:12.603974 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:16:12.603974 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:16:12.603974 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:16:12.603974 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 20:16:12.603974 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 20:16:12.603974 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 20:16:12.605429 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 20:16:12.605429 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 20:16:12.605429 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 20:16:12.605429 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 20:16:12.605429 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 20:16:12.605429 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 20:16:12.605429 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 20:16:12.605429 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 20:16:12.605429 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 20:16:12.605429 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b07e385b-3d8f-4370-a8fc-013a1c785c0f could not be found. Jul 21 20:16:12.605429 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:16:12.605429 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:16:12.605429 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:16:12.605429 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:16:12.605429 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:16:12.605429 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:16:12.605429 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 20:16:12.605429 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 20:16:12.605429 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b07e385b-3d8f-4370-a8fc-013a1c785c0f could not be found. Jul 21 20:16:12.605429 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:16:12.606884 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-af3e6bd4-f395-428b-8ec0-fb82839ab0c0 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Returning 404 to user: Instance b07e385b-3d8f-4370-a8fc-013a1c785c0f could not be found. {{(pid=118345) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 20:16:12.606884 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-af3e6bd4-f395-428b-8ec0-fb82839ab0c0 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 404 len: 111 microversion: 2.20 time: 0.028588 Jul 21 20:16:12.606884 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 514/1002] 10.222.0.58 () {60 vars in 1279 bytes} [Thu Jul 21 20:16:12 2022] DELETE /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 21 20:16:12.611105 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-dea121ba-2784-4f18-b5a1-6d0846d1f7d5 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:16:12.611745 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-dea121ba-2784-4f18-b5a1-6d0846d1f7d5 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] [instance: b07e385b-3d8f-4370-a8fc-013a1c785c0f] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:16:12.618077 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-dea121ba-2784-4f18-b5a1-6d0846d1f7d5 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:12.618513 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-dea121ba-2784-4f18-b5a1-6d0846d1f7d5 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:12.619292 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-dea121ba-2784-4f18-b5a1-6d0846d1f7d5 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:12.619717 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-dea121ba-2784-4f18-b5a1-6d0846d1f7d5 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:12.633752 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.wsgi [None req-dea121ba-2784-4f18-b5a1-6d0846d1f7d5 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] HTTP exception thrown: Instance b07e385b-3d8f-4370-a8fc-013a1c785c0f could not be found. Jul 21 20:16:12.635310 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-dea121ba-2784-4f18-b5a1-6d0846d1f7d5 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Request method failure captured: Jul 21 20:16:12.635310 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: request: GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f HTTP/1.1 Jul 21 20:16:12.635310 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Accept: application/json Jul 21 20:16:12.635310 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Accept-Encoding: identity Jul 21 20:16:12.635310 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Connection: close Jul 21 20:16:12.635310 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Content-Length: 0 Jul 21 20:16:12.635310 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Content-Type: application/json Jul 21 20:16:12.635310 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Host: 10.222.0.58 Jul 21 20:16:12.635310 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Openstack-System-Scope: None Jul 21 20:16:12.635310 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: User-Agent: python-urllib3/1.26.9 Jul 21 20:16:12.635310 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Auth-Token: gAAAAABi2bFmVNxr-PjOOkcTeCXQJ6pQ_y2iOz5ylVO9d7XyC54olaVFhrXWlH2Nketcv2tpxKRFAlpWv7eWy5Dm8T4JnG-iEELS8i5qTa4gA2jB410pUUqzV0CkFgwjk5v525thD23F61IAu7zoqYCKTp1dPl4sdyVA9Xz0i2zTX9M2Fj9lwR0 Jul 21 20:16:12.635310 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Domain-Id: None Jul 21 20:16:12.635310 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Domain-Name: None Jul 21 20:16:12.635310 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Identity-Status: Confirmed Jul 21 20:16:12.635310 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Is-Admin-Project: True Jul 21 20:16:12.635310 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Openstack-Nova-Api-Version: 2.20 Jul 21 20:16:12.635310 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Domain-Id: default Jul 21 20:16:12.635310 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Domain-Name: Default Jul 21 20:16:12.635310 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Id: f8ece8b465c04d33998002f8d880d556 Jul 21 20:16:12.635310 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1726184728 Jul 21 20:16:12.635310 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Role: reader,member Jul 21 20:16:12.635310 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Roles: reader,member Jul 21 20:16:12.636910 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f8ece8b465c04d33998002f8d880d556"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f8ece8b465c04d33998002f8d880d556"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f8ece8b465c04d33998002f8d880d556"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f8ece8b465c04d33998002f8d880d556"}]}] Jul 21 20:16:12.636910 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1726184728 Jul 21 20:16:12.636910 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Tenant-Id: f8ece8b465c04d33998002f8d880d556 Jul 21 20:16:12.636910 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1726184728 Jul 21 20:16:12.636910 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User: tempest-AttachVolumeShelveTestJSON-1726184728-project Jul 21 20:16:12.636910 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Domain-Id: default Jul 21 20:16:12.636910 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Domain-Name: Default Jul 21 20:16:12.636910 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Id: 02a93000972547d08f11f7ed23264d31 Jul 21 20:16:12.636910 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1726184728-project Jul 21 20:16:12.636910 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: method: > Jul 21 20:16:12.636910 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: exception: Instance b07e385b-3d8f-4370-a8fc-013a1c785c0f could not be found. Jul 21 20:16:12.636910 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: action_args: {'id': 'b07e385b-3d8f-4370-a8fc-013a1c785c0f'} Jul 21 20:16:12.637659 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 20:16:12.637659 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:16:12.637659 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 20:16:12.637659 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 20:16:12.637659 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 20:16:12.637659 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 20:16:12.637659 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 20:16:12.637659 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 20:16:12.637659 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 20:16:12.637659 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 20:16:12.637659 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b07e385b-3d8f-4370-a8fc-013a1c785c0f could not be found. Jul 21 20:16:12.637659 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:16:12.637659 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:16:12.637659 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:16:12.637659 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:16:12.637659 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:16:12.637659 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:16:12.637659 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 20:16:12.637659 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 20:16:12.637659 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 20:16:12.639266 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 20:16:12.639266 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 20:16:12.639266 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 20:16:12.639266 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 20:16:12.639266 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 20:16:12.639266 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 20:16:12.639266 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 20:16:12.639266 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b07e385b-3d8f-4370-a8fc-013a1c785c0f could not be found. Jul 21 20:16:12.639266 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:16:12.639266 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:16:12.639266 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:16:12.639266 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:16:12.639266 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:16:12.639266 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:16:12.639266 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 20:16:12.639266 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 20:16:12.639266 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b07e385b-3d8f-4370-a8fc-013a1c785c0f could not be found. Jul 21 20:16:12.639266 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:16:12.640733 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-dea121ba-2784-4f18-b5a1-6d0846d1f7d5 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] Returning 404 to user: Instance b07e385b-3d8f-4370-a8fc-013a1c785c0f could not be found. {{(pid=118344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 20:16:12.640733 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-dea121ba-2784-4f18-b5a1-6d0846d1f7d5 tempest-AttachVolumeShelveTestJSON-1726184728 tempest-AttachVolumeShelveTestJSON-1726184728-project] 10.222.0.58 "GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f" status: 404 len: 111 microversion: 2.20 time: 0.029438 Jul 21 20:16:12.640733 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 489/1003] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 20:16:12 2022] GET /compute/v2.1/servers/b07e385b-3d8f-4370-a8fc-013a1c785c0f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 21 20:16:12.851917 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-ba5b4a82-fd0d-4dac-b60c-11e6425bcf3d tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:16:12.852492 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-ba5b4a82-fd0d-4dac-b60c-11e6425bcf3d tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] [instance: 61231bf8-a454-4ae4-b94e-0193a0f45096] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:16:12.858928 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ba5b4a82-fd0d-4dac-b60c-11e6425bcf3d tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:12.859407 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ba5b4a82-fd0d-4dac-b60c-11e6425bcf3d tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:12.860169 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ba5b4a82-fd0d-4dac-b60c-11e6425bcf3d tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:12.860599 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ba5b4a82-fd0d-4dac-b60c-11e6425bcf3d tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:13.073037 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-ba5b4a82-fd0d-4dac-b60c-11e6425bcf3d tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6329f88fae384f20ad2f6aa66dc9864f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a0044f6e28474da9f3789f27654523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:16:13.081737 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-ba5b4a82-fd0d-4dac-b60c-11e6425bcf3d tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] 10.222.0.58 "GET /compute/v2.1/servers/61231bf8-a454-4ae4-b94e-0193a0f45096" status: 200 len: 1314 microversion: 2.1 time: 0.234319 Jul 21 20:16:13.082381 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 515/1004] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:16:12 2022] GET /compute/v2.1/servers/61231bf8-a454-4ae4-b94e-0193a0f45096 => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:16:13.519882 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-aaaef33f-5ab0-4ff9-a8d0-e9820309a723 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:16:13.521234 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-aaaef33f-5ab0-4ff9-a8d0-e9820309a723 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 392749b4-22f6-470d-9b2e-4a9b2ded152b] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:16:13.528053 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-aaaef33f-5ab0-4ff9-a8d0-e9820309a723 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:13.528505 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-aaaef33f-5ab0-4ff9-a8d0-e9820309a723 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:13.529270 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-aaaef33f-5ab0-4ff9-a8d0-e9820309a723 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:13.529702 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-aaaef33f-5ab0-4ff9-a8d0-e9820309a723 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:13.659105 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-aaaef33f-5ab0-4ff9-a8d0-e9820309a723 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:16:13.668395 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-aaaef33f-5ab0-4ff9-a8d0-e9820309a723 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/392749b4-22f6-470d-9b2e-4a9b2ded152b" status: 200 len: 1682 microversion: 2.1 time: 0.152346 Jul 21 20:16:13.669209 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 490/1005] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:16:13 2022] GET /compute/v2.1/servers/392749b4-22f6-470d-9b2e-4a9b2ded152b => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:16:14.099336 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-531f51f5-e701-4c6d-bad9-763e7870e431 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:16:14.099941 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-531f51f5-e701-4c6d-bad9-763e7870e431 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] [instance: 61231bf8-a454-4ae4-b94e-0193a0f45096] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:16:14.106951 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-531f51f5-e701-4c6d-bad9-763e7870e431 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:14.107331 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-531f51f5-e701-4c6d-bad9-763e7870e431 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:14.108019 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-531f51f5-e701-4c6d-bad9-763e7870e431 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:14.108447 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-531f51f5-e701-4c6d-bad9-763e7870e431 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:14.324845 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-531f51f5-e701-4c6d-bad9-763e7870e431 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6329f88fae384f20ad2f6aa66dc9864f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a0044f6e28474da9f3789f27654523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:16:14.333355 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-531f51f5-e701-4c6d-bad9-763e7870e431 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] 10.222.0.58 "GET /compute/v2.1/servers/61231bf8-a454-4ae4-b94e-0193a0f45096" status: 200 len: 1314 microversion: 2.1 time: 0.238435 Jul 21 20:16:14.334145 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 516/1006] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:16:14 2022] GET /compute/v2.1/servers/61231bf8-a454-4ae4-b94e-0193a0f45096 => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:16:14.686426 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-fbe6d101-8e4c-41e4-a115-94d194622f9a tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:16:14.687749 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-fbe6d101-8e4c-41e4-a115-94d194622f9a tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 392749b4-22f6-470d-9b2e-4a9b2ded152b] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:16:14.694615 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-fbe6d101-8e4c-41e4-a115-94d194622f9a tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:14.695536 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-fbe6d101-8e4c-41e4-a115-94d194622f9a tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:14.702198 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-fbe6d101-8e4c-41e4-a115-94d194622f9a tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:14.702198 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-fbe6d101-8e4c-41e4-a115-94d194622f9a tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:14.867241 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-fbe6d101-8e4c-41e4-a115-94d194622f9a tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:16:14.877099 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-fbe6d101-8e4c-41e4-a115-94d194622f9a tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/392749b4-22f6-470d-9b2e-4a9b2ded152b" status: 200 len: 1682 microversion: 2.1 time: 0.194536 Jul 21 20:16:14.881621 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 491/1007] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:16:14 2022] GET /compute/v2.1/servers/392749b4-22f6-470d-9b2e-4a9b2ded152b => generated 1682 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:16:15.351758 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-34d76973-9363-4f04-860e-43095b7c9339 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:16:15.352368 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-34d76973-9363-4f04-860e-43095b7c9339 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] [instance: 61231bf8-a454-4ae4-b94e-0193a0f45096] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:16:15.358948 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-34d76973-9363-4f04-860e-43095b7c9339 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:15.359445 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-34d76973-9363-4f04-860e-43095b7c9339 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:15.360206 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-34d76973-9363-4f04-860e-43095b7c9339 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:15.360645 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-34d76973-9363-4f04-860e-43095b7c9339 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:15.504698 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-34d76973-9363-4f04-860e-43095b7c9339 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6329f88fae384f20ad2f6aa66dc9864f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a0044f6e28474da9f3789f27654523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:16:15.516350 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-34d76973-9363-4f04-860e-43095b7c9339 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] 10.222.0.58 "GET /compute/v2.1/servers/61231bf8-a454-4ae4-b94e-0193a0f45096" status: 200 len: 1314 microversion: 2.1 time: 0.168946 Jul 21 20:16:15.516948 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 517/1008] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:16:15 2022] GET /compute/v2.1/servers/61231bf8-a454-4ae4-b94e-0193a0f45096 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:16:15.896042 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-43a389bc-bc86-4602-a5ef-2882999f7756 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:16:15.897571 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-43a389bc-bc86-4602-a5ef-2882999f7756 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 392749b4-22f6-470d-9b2e-4a9b2ded152b] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:16:15.901141 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG dbcounter [-] [118344] Writing DB stats nova_cell0:SELECT=2 {{(pid=118344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:16:15.907239 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG dbcounter [-] [118344] Writing DB stats nova_cell0:SELECT=6 {{(pid=118344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:16:15.907239 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-43a389bc-bc86-4602-a5ef-2882999f7756 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:15.907239 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-43a389bc-bc86-4602-a5ef-2882999f7756 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:15.907239 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-43a389bc-bc86-4602-a5ef-2882999f7756 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:15.907657 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-43a389bc-bc86-4602-a5ef-2882999f7756 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:16.458974 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-43a389bc-bc86-4602-a5ef-2882999f7756 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:16:16.467299 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-43a389bc-bc86-4602-a5ef-2882999f7756 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/392749b4-22f6-470d-9b2e-4a9b2ded152b" status: 200 len: 1682 microversion: 2.1 time: 0.576054 Jul 21 20:16:16.468824 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 492/1009] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:16:15 2022] GET /compute/v2.1/servers/392749b4-22f6-470d-9b2e-4a9b2ded152b => generated 1682 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:16:16.478647 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [req-65bbe4f0-cc40-4b47-9781-a7b967ac12c7 req-5b51a84e-1cc2-4716-ab3a-3e3c51f8bb4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61231bf8-a454-4ae4-b94e-0193a0f45096", "name": "network-vif-plugged", "status": "completed", "tag": "b7d66ba5-3ef5-4913-a529-1308eabeee5e"}]} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:16:16.484690 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell0:SELECT=2 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:16:16.489773 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-65bbe4f0-cc40-4b47-9781-a7b967ac12c7 req-5b51a84e-1cc2-4716-ab3a-3e3c51f8bb4a service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:16.489773 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-65bbe4f0-cc40-4b47-9781-a7b967ac12c7 req-5b51a84e-1cc2-4716-ab3a-3e3c51f8bb4a service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:16.501253 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.compute.server_external_events [req-65bbe4f0-cc40-4b47-9781-a7b967ac12c7 req-5b51a84e-1cc2-4716-ab3a-3e3c51f8bb4a service nova] Creating event network-vif-plugged:b7d66ba5-3ef5-4913-a529-1308eabeee5e for instance 61231bf8-a454-4ae4-b94e-0193a0f45096 on hv-cinder-85054 Jul 21 20:16:16.506611 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [req-65bbe4f0-cc40-4b47-9781-a7b967ac12c7 req-5b51a84e-1cc2-4716-ab3a-3e3c51f8bb4a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034986 Jul 21 20:16:16.507257 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 518/1010] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 20:16:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:16:16.533824 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-d4f90c8f-b583-4e8d-a491-d4538ad7b2bf tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:16:16.535060 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-d4f90c8f-b583-4e8d-a491-d4538ad7b2bf tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] [instance: 61231bf8-a454-4ae4-b94e-0193a0f45096] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:16:16.548744 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-d4f90c8f-b583-4e8d-a491-d4538ad7b2bf tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:16.549219 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-d4f90c8f-b583-4e8d-a491-d4538ad7b2bf tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:16.550029 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-d4f90c8f-b583-4e8d-a491-d4538ad7b2bf tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:16.550634 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-d4f90c8f-b583-4e8d-a491-d4538ad7b2bf tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:16.866371 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-d4f90c8f-b583-4e8d-a491-d4538ad7b2bf tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6329f88fae384f20ad2f6aa66dc9864f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a0044f6e28474da9f3789f27654523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:16:16.878077 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-d4f90c8f-b583-4e8d-a491-d4538ad7b2bf tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] 10.222.0.58 "GET /compute/v2.1/servers/61231bf8-a454-4ae4-b94e-0193a0f45096" status: 200 len: 1314 microversion: 2.1 time: 0.348123 Jul 21 20:16:16.879205 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 493/1011] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:16:16 2022] GET /compute/v2.1/servers/61231bf8-a454-4ae4-b94e-0193a0f45096 => generated 1314 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:16:17.089007 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [req-078315a8-a117-4254-b35a-66b34bfb78a5 req-252d30a5-7b75-44f9-8960-f1ce80eecd73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "392749b4-22f6-470d-9b2e-4a9b2ded152b", "name": "network-vif-deleted", "tag": "a0a4f662-60e3-4ba4-829f-a5e0a18505d8"}]} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:16:17.099165 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-078315a8-a117-4254-b35a-66b34bfb78a5 req-252d30a5-7b75-44f9-8960-f1ce80eecd73 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:17.100414 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-078315a8-a117-4254-b35a-66b34bfb78a5 req-252d30a5-7b75-44f9-8960-f1ce80eecd73 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:17.110829 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.compute.server_external_events [req-078315a8-a117-4254-b35a-66b34bfb78a5 req-252d30a5-7b75-44f9-8960-f1ce80eecd73 service nova] Creating event network-vif-deleted:a0a4f662-60e3-4ba4-829f-a5e0a18505d8 for instance 392749b4-22f6-470d-9b2e-4a9b2ded152b on hv-cinder-85054 Jul 21 20:16:17.115644 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [req-078315a8-a117-4254-b35a-66b34bfb78a5 req-252d30a5-7b75-44f9-8960-f1ce80eecd73 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031008 Jul 21 20:16:17.116229 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 519/1012] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 20:16:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:16:17.485796 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-f8d5047c-1fba-4841-9126-48416acbca12 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:16:17.487006 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-f8d5047c-1fba-4841-9126-48416acbca12 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 392749b4-22f6-470d-9b2e-4a9b2ded152b] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:16:17.495432 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f8d5047c-1fba-4841-9126-48416acbca12 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:17.501697 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f8d5047c-1fba-4841-9126-48416acbca12 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:17.501697 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f8d5047c-1fba-4841-9126-48416acbca12 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:17.501697 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f8d5047c-1fba-4841-9126-48416acbca12 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:17.564624 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-f8d5047c-1fba-4841-9126-48416acbca12 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:16:17.573080 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-f8d5047c-1fba-4841-9126-48416acbca12 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/392749b4-22f6-470d-9b2e-4a9b2ded152b" status: 200 len: 1327 microversion: 2.1 time: 0.091187 Jul 21 20:16:17.576135 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 494/1013] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:16:17 2022] GET /compute/v2.1/servers/392749b4-22f6-470d-9b2e-4a9b2ded152b => generated 1327 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:16:17.897693 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-3068973a-b730-4b29-98d9-15b141a9b989 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:16:17.898500 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-3068973a-b730-4b29-98d9-15b141a9b989 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] [instance: 61231bf8-a454-4ae4-b94e-0193a0f45096] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:16:17.904772 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3068973a-b730-4b29-98d9-15b141a9b989 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:17.905218 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3068973a-b730-4b29-98d9-15b141a9b989 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:17.905989 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3068973a-b730-4b29-98d9-15b141a9b989 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:17.906441 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3068973a-b730-4b29-98d9-15b141a9b989 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:18.072434 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-3068973a-b730-4b29-98d9-15b141a9b989 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6329f88fae384f20ad2f6aa66dc9864f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a0044f6e28474da9f3789f27654523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:16:18.081733 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-3068973a-b730-4b29-98d9-15b141a9b989 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] 10.222.0.58 "GET /compute/v2.1/servers/61231bf8-a454-4ae4-b94e-0193a0f45096" status: 200 len: 1314 microversion: 2.1 time: 0.188529 Jul 21 20:16:18.082391 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 520/1014] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:16:17 2022] GET /compute/v2.1/servers/61231bf8-a454-4ae4-b94e-0193a0f45096 => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:16:18.589703 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-50654ea6-c8b5-429f-ab7f-63ac5c50b937 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:16:18.590404 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-50654ea6-c8b5-429f-ab7f-63ac5c50b937 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 392749b4-22f6-470d-9b2e-4a9b2ded152b] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:16:18.597362 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-50654ea6-c8b5-429f-ab7f-63ac5c50b937 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:18.597810 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-50654ea6-c8b5-429f-ab7f-63ac5c50b937 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:18.599077 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-50654ea6-c8b5-429f-ab7f-63ac5c50b937 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:18.599077 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-50654ea6-c8b5-429f-ab7f-63ac5c50b937 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:18.632021 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-50654ea6-c8b5-429f-ab7f-63ac5c50b937 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:18.632726 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-50654ea6-c8b5-429f-ab7f-63ac5c50b937 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:18.633189 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.objects.instance [None req-50654ea6-c8b5-429f-ab7f-63ac5c50b937 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lazy-loading 'fault' on Instance uuid 392749b4-22f6-470d-9b2e-4a9b2ded152b {{(pid=118344) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 20:16:18.636163 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG dbcounter [-] [118344] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:16:18.674453 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-50654ea6-c8b5-429f-ab7f-63ac5c50b937 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04a0e68aea7424181f6c2728cbf7e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0075f5ba84547c782504d23f6029fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:16:18.682459 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-50654ea6-c8b5-429f-ab7f-63ac5c50b937 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/392749b4-22f6-470d-9b2e-4a9b2ded152b" status: 200 len: 1332 microversion: 2.1 time: 0.096585 Jul 21 20:16:18.683216 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 495/1015] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:16:18 2022] GET /compute/v2.1/servers/392749b4-22f6-470d-9b2e-4a9b2ded152b => generated 1332 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:16:19.100054 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-91855d02-8dd6-479b-b336-9689e549eca3 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:16:19.100702 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-91855d02-8dd6-479b-b336-9689e549eca3 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] [instance: 61231bf8-a454-4ae4-b94e-0193a0f45096] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:16:19.107145 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-91855d02-8dd6-479b-b336-9689e549eca3 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:19.107590 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-91855d02-8dd6-479b-b336-9689e549eca3 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:19.108373 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-91855d02-8dd6-479b-b336-9689e549eca3 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:19.108803 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-91855d02-8dd6-479b-b336-9689e549eca3 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:19.241667 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-91855d02-8dd6-479b-b336-9689e549eca3 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6329f88fae384f20ad2f6aa66dc9864f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a0044f6e28474da9f3789f27654523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:16:19.249127 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-91855d02-8dd6-479b-b336-9689e549eca3 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] 10.222.0.58 "GET /compute/v2.1/servers/61231bf8-a454-4ae4-b94e-0193a0f45096" status: 200 len: 1498 microversion: 2.1 time: 0.153743 Jul 21 20:16:19.249678 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 521/1016] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:16:19 2022] GET /compute/v2.1/servers/61231bf8-a454-4ae4-b94e-0193a0f45096 => generated 1498 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:16:19.700280 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-e7b9edea-3df0-4c7b-af64-f3c90f49e803 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:16:19.700927 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-e7b9edea-3df0-4c7b-af64-f3c90f49e803 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 392749b4-22f6-470d-9b2e-4a9b2ded152b] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:16:19.708827 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-e7b9edea-3df0-4c7b-af64-f3c90f49e803 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:19.709274 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-e7b9edea-3df0-4c7b-af64-f3c90f49e803 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:19.710033 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-e7b9edea-3df0-4c7b-af64-f3c90f49e803 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:19.710471 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-e7b9edea-3df0-4c7b-af64-f3c90f49e803 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:19.724225 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.wsgi [None req-e7b9edea-3df0-4c7b-af64-f3c90f49e803 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] HTTP exception thrown: Instance 392749b4-22f6-470d-9b2e-4a9b2ded152b could not be found. Jul 21 20:16:19.725780 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-e7b9edea-3df0-4c7b-af64-f3c90f49e803 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Request method failure captured: Jul 21 20:16:19.725780 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: request: GET /compute/v2.1/servers/392749b4-22f6-470d-9b2e-4a9b2ded152b HTTP/1.1 Jul 21 20:16:19.725780 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Accept: application/json Jul 21 20:16:19.725780 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Accept-Encoding: identity Jul 21 20:16:19.725780 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Connection: close Jul 21 20:16:19.725780 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Content-Length: 0 Jul 21 20:16:19.725780 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Content-Type: application/json Jul 21 20:16:19.725780 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Host: 10.222.0.58 Jul 21 20:16:19.725780 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Openstack-System-Scope: None Jul 21 20:16:19.725780 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: User-Agent: python-urllib3/1.26.9 Jul 21 20:16:19.725780 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Auth-Token: gAAAAABi2bFjKCUxQrNdZsEJV1kBJFiLgTT1Ekl7oj8yg_h_7YxyA7duEHuPdhQkp4Jd1ksQT4I6f50cht2hanCT9gvKpkDXVC1Uog_MnmqMteApPkGCv4CO2lrQc2eP7fSnvkh1csaG9QP2Dj0psWvWObuaYy8zQZsTJEhGK2eg_fgoqVDBHDI Jul 21 20:16:19.725780 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Domain-Id: None Jul 21 20:16:19.725780 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Domain-Name: None Jul 21 20:16:19.725780 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Identity-Status: Confirmed Jul 21 20:16:19.725780 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Is-Admin-Project: True Jul 21 20:16:19.725780 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Domain-Id: default Jul 21 20:16:19.725780 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Domain-Name: Default Jul 21 20:16:19.725780 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Id: e0075f5ba84547c782504d23f6029fd2 Jul 21 20:16:19.725780 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Name: tempest-AttachVolumeNegativeTest-1294836183 Jul 21 20:16:19.725780 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Role: reader,member Jul 21 20:16:19.725780 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Roles: reader,member Jul 21 20:16:19.727432 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e0075f5ba84547c782504d23f6029fd2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e0075f5ba84547c782504d23f6029fd2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e0075f5ba84547c782504d23f6029fd2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e0075f5ba84547c782504d23f6029fd2"}]}] Jul 21 20:16:19.727432 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Tenant: tempest-AttachVolumeNegativeTest-1294836183 Jul 21 20:16:19.727432 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Tenant-Id: e0075f5ba84547c782504d23f6029fd2 Jul 21 20:16:19.727432 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1294836183 Jul 21 20:16:19.727432 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User: tempest-AttachVolumeNegativeTest-1294836183-project Jul 21 20:16:19.727432 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Domain-Id: default Jul 21 20:16:19.727432 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Domain-Name: Default Jul 21 20:16:19.727432 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Id: d04a0e68aea7424181f6c2728cbf7e3f Jul 21 20:16:19.727432 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Name: tempest-AttachVolumeNegativeTest-1294836183-project Jul 21 20:16:19.727432 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: method: > Jul 21 20:16:19.727432 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: exception: Instance 392749b4-22f6-470d-9b2e-4a9b2ded152b could not be found. Jul 21 20:16:19.727432 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: action_args: {'id': '392749b4-22f6-470d-9b2e-4a9b2ded152b'} Jul 21 20:16:19.728418 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 20:16:19.728418 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:16:19.728418 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 20:16:19.728418 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 20:16:19.728418 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 20:16:19.728418 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 20:16:19.728418 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 20:16:19.728418 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 20:16:19.728418 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 20:16:19.728418 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 20:16:19.728418 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 392749b4-22f6-470d-9b2e-4a9b2ded152b could not be found. Jul 21 20:16:19.728418 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:16:19.728418 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:16:19.728418 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:16:19.728418 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:16:19.728418 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:16:19.728418 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:16:19.728418 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 20:16:19.728418 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 20:16:19.728418 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 20:16:19.729710 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 20:16:19.729710 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 20:16:19.729710 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 20:16:19.729710 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 20:16:19.729710 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 20:16:19.729710 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 20:16:19.729710 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 20:16:19.729710 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 392749b4-22f6-470d-9b2e-4a9b2ded152b could not be found. Jul 21 20:16:19.729710 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:16:19.729710 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:16:19.729710 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:16:19.729710 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:16:19.729710 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:16:19.729710 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:16:19.729710 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 20:16:19.729710 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 20:16:19.729710 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 392749b4-22f6-470d-9b2e-4a9b2ded152b could not be found. Jul 21 20:16:19.729710 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:16:19.731061 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-e7b9edea-3df0-4c7b-af64-f3c90f49e803 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Returning 404 to user: Instance 392749b4-22f6-470d-9b2e-4a9b2ded152b could not be found. {{(pid=118344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 20:16:19.731061 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-e7b9edea-3df0-4c7b-af64-f3c90f49e803 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/392749b4-22f6-470d-9b2e-4a9b2ded152b" status: 404 len: 111 microversion: 2.1 time: 0.030818 Jul 21 20:16:19.731061 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 496/1017] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:16:19 2022] GET /compute/v2.1/servers/392749b4-22f6-470d-9b2e-4a9b2ded152b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 20:16:19.736229 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-e7578ed6-90ed-42ec-a00a-d3598af2121b tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '.version_select at 0x7f351cc08e50>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:16:19.824916 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-e7578ed6-90ed-42ec-a00a-d3598af2121b tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2053320477" status: 202 len: 0 microversion: 2.1 time: 0.092448 Jul 21 20:16:19.825511 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 522/1018] 10.222.0.58 () {58 vars in 1220 bytes} [Thu Jul 21 20:16:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2053320477 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 20:16:20.436867 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-0c2c79db-cdd2-456c-95fb-aaed0389f6ed tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:16:20.437433 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-0c2c79db-cdd2-456c-95fb-aaed0389f6ed tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] [instance: 61231bf8-a454-4ae4-b94e-0193a0f45096] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:16:20.444440 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-0c2c79db-cdd2-456c-95fb-aaed0389f6ed tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:20.444879 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-0c2c79db-cdd2-456c-95fb-aaed0389f6ed tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:20.445648 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-0c2c79db-cdd2-456c-95fb-aaed0389f6ed tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:20.446077 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-0c2c79db-cdd2-456c-95fb-aaed0389f6ed tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:20.471875 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-0c2c79db-cdd2-456c-95fb-aaed0389f6ed tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] [instance: 61231bf8-a454-4ae4-b94e-0193a0f45096] Going to try to terminate instance {{(pid=118344) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 20:16:20.732888 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-0c2c79db-cdd2-456c-95fb-aaed0389f6ed tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] 10.222.0.58 "DELETE /compute/v2.1/servers/61231bf8-a454-4ae4-b94e-0193a0f45096" status: 204 len: 0 microversion: 2.1 time: 0.299702 Jul 21 20:16:20.733495 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 497/1019] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Jul 21 20:16:20 2022] DELETE /compute/v2.1/servers/61231bf8-a454-4ae4-b94e-0193a0f45096 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 20:16:20.742021 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-dcb3131a-1c7d-4882-9718-ac6eac55e82a tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:16:20.742722 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-dcb3131a-1c7d-4882-9718-ac6eac55e82a tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] [instance: 61231bf8-a454-4ae4-b94e-0193a0f45096] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:16:20.748902 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-dcb3131a-1c7d-4882-9718-ac6eac55e82a tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:20.749340 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-dcb3131a-1c7d-4882-9718-ac6eac55e82a tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:20.750087 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-dcb3131a-1c7d-4882-9718-ac6eac55e82a tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:20.750509 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-dcb3131a-1c7d-4882-9718-ac6eac55e82a tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:20.890986 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-dcb3131a-1c7d-4882-9718-ac6eac55e82a tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6329f88fae384f20ad2f6aa66dc9864f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a0044f6e28474da9f3789f27654523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:16:20.898923 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-dcb3131a-1c7d-4882-9718-ac6eac55e82a tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] 10.222.0.58 "GET /compute/v2.1/servers/61231bf8-a454-4ae4-b94e-0193a0f45096" status: 200 len: 1504 microversion: 2.1 time: 0.161255 Jul 21 20:16:20.899535 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 523/1020] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:16:20 2022] GET /compute/v2.1/servers/61231bf8-a454-4ae4-b94e-0193a0f45096 => generated 1504 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:16:21.623126 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-3cd74f4d-f4a4-4be8-a37c-0c4f8402bfb8 tempest-VolumesTestJSON-672841738 tempest-VolumesTestJSON-672841738-project] Calling method '.version_select at 0x7f351cb29ee0>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:16:21.669381 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-3cd74f4d-f4a4-4be8-a37c-0c4f8402bfb8 tempest-VolumesTestJSON-672841738 tempest-VolumesTestJSON-672841738-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/1473f279-6f92-49a1-8183-b9bb1984e724" status: 200 len: 351 microversion: 2.1 time: 0.050523 Jul 21 20:16:21.669958 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 498/1021] 10.222.0.58 () {58 vars in 1244 bytes} [Thu Jul 21 20:16:21 2022] GET /compute/v2.1/os-volumes/1473f279-6f92-49a1-8183-b9bb1984e724 => generated 351 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:16:21.869993 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-8a37ff67-055b-4309-9d65-a67794db8495 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:16:21.870538 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-8a37ff67-055b-4309-9d65-a67794db8495 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 392749b4-22f6-470d-9b2e-4a9b2ded152b] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:16:21.876916 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8a37ff67-055b-4309-9d65-a67794db8495 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:21.877357 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8a37ff67-055b-4309-9d65-a67794db8495 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:21.878118 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8a37ff67-055b-4309-9d65-a67794db8495 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:21.878547 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8a37ff67-055b-4309-9d65-a67794db8495 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:21.891601 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.wsgi [None req-8a37ff67-055b-4309-9d65-a67794db8495 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] HTTP exception thrown: Instance 392749b4-22f6-470d-9b2e-4a9b2ded152b could not be found. Jul 21 20:16:21.893233 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-8a37ff67-055b-4309-9d65-a67794db8495 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Request method failure captured: Jul 21 20:16:21.893233 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: request: DELETE /compute/v2.1/servers/392749b4-22f6-470d-9b2e-4a9b2ded152b HTTP/1.1 Jul 21 20:16:21.893233 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Accept: application/json Jul 21 20:16:21.893233 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Accept-Encoding: identity Jul 21 20:16:21.893233 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Connection: close Jul 21 20:16:21.893233 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Content-Length: 0 Jul 21 20:16:21.893233 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Content-Type: application/json Jul 21 20:16:21.893233 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Host: 10.222.0.58 Jul 21 20:16:21.893233 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Openstack-System-Scope: None Jul 21 20:16:21.893233 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: User-Agent: python-urllib3/1.26.9 Jul 21 20:16:21.893233 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Auth-Token: gAAAAABi2bFjKCUxQrNdZsEJV1kBJFiLgTT1Ekl7oj8yg_h_7YxyA7duEHuPdhQkp4Jd1ksQT4I6f50cht2hanCT9gvKpkDXVC1Uog_MnmqMteApPkGCv4CO2lrQc2eP7fSnvkh1csaG9QP2Dj0psWvWObuaYy8zQZsTJEhGK2eg_fgoqVDBHDI Jul 21 20:16:21.893233 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Domain-Id: None Jul 21 20:16:21.893233 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Domain-Name: None Jul 21 20:16:21.893233 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Identity-Status: Confirmed Jul 21 20:16:21.893233 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Is-Admin-Project: True Jul 21 20:16:21.893233 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Id: default Jul 21 20:16:21.893233 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Name: Default Jul 21 20:16:21.893233 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Id: e0075f5ba84547c782504d23f6029fd2 Jul 21 20:16:21.893233 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Name: tempest-AttachVolumeNegativeTest-1294836183 Jul 21 20:16:21.893233 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Role: reader,member Jul 21 20:16:21.893233 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Roles: reader,member Jul 21 20:16:21.894834 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e0075f5ba84547c782504d23f6029fd2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e0075f5ba84547c782504d23f6029fd2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e0075f5ba84547c782504d23f6029fd2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e0075f5ba84547c782504d23f6029fd2"}]}] Jul 21 20:16:21.894834 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Tenant: tempest-AttachVolumeNegativeTest-1294836183 Jul 21 20:16:21.894834 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Tenant-Id: e0075f5ba84547c782504d23f6029fd2 Jul 21 20:16:21.894834 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1294836183 Jul 21 20:16:21.894834 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User: tempest-AttachVolumeNegativeTest-1294836183-project Jul 21 20:16:21.894834 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Id: default Jul 21 20:16:21.894834 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Name: Default Jul 21 20:16:21.894834 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Id: d04a0e68aea7424181f6c2728cbf7e3f Jul 21 20:16:21.894834 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Name: tempest-AttachVolumeNegativeTest-1294836183-project Jul 21 20:16:21.894834 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: method: > Jul 21 20:16:21.894834 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: exception: Instance 392749b4-22f6-470d-9b2e-4a9b2ded152b could not be found. Jul 21 20:16:21.894834 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: action_args: {'id': '392749b4-22f6-470d-9b2e-4a9b2ded152b'} Jul 21 20:16:21.895767 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 20:16:21.895767 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:16:21.895767 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 20:16:21.895767 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 20:16:21.895767 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 20:16:21.895767 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 20:16:21.895767 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 20:16:21.895767 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 20:16:21.895767 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 20:16:21.895767 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 20:16:21.895767 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 392749b4-22f6-470d-9b2e-4a9b2ded152b could not be found. Jul 21 20:16:21.895767 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:16:21.895767 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:16:21.895767 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:16:21.895767 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:16:21.895767 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:16:21.895767 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:16:21.895767 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 20:16:21.895767 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 20:16:21.895767 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 20:16:21.897217 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 20:16:21.897217 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 20:16:21.897217 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 20:16:21.897217 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 20:16:21.897217 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 20:16:21.897217 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 20:16:21.897217 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 20:16:21.897217 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 20:16:21.897217 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 20:16:21.897217 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 392749b4-22f6-470d-9b2e-4a9b2ded152b could not be found. Jul 21 20:16:21.897217 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:16:21.897217 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:16:21.897217 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:16:21.897217 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:16:21.897217 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:16:21.897217 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:16:21.897217 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 20:16:21.897217 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 20:16:21.897217 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 392749b4-22f6-470d-9b2e-4a9b2ded152b could not be found. Jul 21 20:16:21.897217 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:16:21.898988 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-8a37ff67-055b-4309-9d65-a67794db8495 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Returning 404 to user: Instance 392749b4-22f6-470d-9b2e-4a9b2ded152b could not be found. {{(pid=118345) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 20:16:21.898988 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-8a37ff67-055b-4309-9d65-a67794db8495 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "DELETE /compute/v2.1/servers/392749b4-22f6-470d-9b2e-4a9b2ded152b" status: 404 len: 111 microversion: 2.1 time: 0.028501 Jul 21 20:16:21.898988 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 524/1022] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Jul 21 20:16:21 2022] DELETE /compute/v2.1/servers/392749b4-22f6-470d-9b2e-4a9b2ded152b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 20:16:21.904722 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-8525b113-26fe-4f2c-a6f6-2dbaabd01311 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:16:21.905452 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-8525b113-26fe-4f2c-a6f6-2dbaabd01311 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 392749b4-22f6-470d-9b2e-4a9b2ded152b] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:16:21.912751 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-8525b113-26fe-4f2c-a6f6-2dbaabd01311 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:21.913410 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-8525b113-26fe-4f2c-a6f6-2dbaabd01311 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:21.914344 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-8525b113-26fe-4f2c-a6f6-2dbaabd01311 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:21.914938 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-8525b113-26fe-4f2c-a6f6-2dbaabd01311 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:21.916962 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-07e6a777-32a7-43be-ae1f-dec127556d4a tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:16:21.917640 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-07e6a777-32a7-43be-ae1f-dec127556d4a tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] [instance: 61231bf8-a454-4ae4-b94e-0193a0f45096] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:16:21.924750 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-07e6a777-32a7-43be-ae1f-dec127556d4a tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:21.924750 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-07e6a777-32a7-43be-ae1f-dec127556d4a tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:21.924977 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-07e6a777-32a7-43be-ae1f-dec127556d4a tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:21.925384 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-07e6a777-32a7-43be-ae1f-dec127556d4a tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:21.934257 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.wsgi [None req-8525b113-26fe-4f2c-a6f6-2dbaabd01311 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] HTTP exception thrown: Instance 392749b4-22f6-470d-9b2e-4a9b2ded152b could not be found. Jul 21 20:16:21.936032 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-8525b113-26fe-4f2c-a6f6-2dbaabd01311 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Request method failure captured: Jul 21 20:16:21.936032 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: request: GET /compute/v2.1/servers/392749b4-22f6-470d-9b2e-4a9b2ded152b HTTP/1.1 Jul 21 20:16:21.936032 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Accept: application/json Jul 21 20:16:21.936032 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Accept-Encoding: identity Jul 21 20:16:21.936032 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Connection: close Jul 21 20:16:21.936032 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Content-Length: 0 Jul 21 20:16:21.936032 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Content-Type: application/json Jul 21 20:16:21.936032 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Host: 10.222.0.58 Jul 21 20:16:21.936032 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Openstack-System-Scope: None Jul 21 20:16:21.936032 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: User-Agent: python-urllib3/1.26.9 Jul 21 20:16:21.936032 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Auth-Token: gAAAAABi2bFjKCUxQrNdZsEJV1kBJFiLgTT1Ekl7oj8yg_h_7YxyA7duEHuPdhQkp4Jd1ksQT4I6f50cht2hanCT9gvKpkDXVC1Uog_MnmqMteApPkGCv4CO2lrQc2eP7fSnvkh1csaG9QP2Dj0psWvWObuaYy8zQZsTJEhGK2eg_fgoqVDBHDI Jul 21 20:16:21.936032 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Domain-Id: None Jul 21 20:16:21.936032 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Domain-Name: None Jul 21 20:16:21.936032 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Identity-Status: Confirmed Jul 21 20:16:21.936032 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Is-Admin-Project: True Jul 21 20:16:21.936032 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Domain-Id: default Jul 21 20:16:21.936032 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Domain-Name: Default Jul 21 20:16:21.936032 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Id: e0075f5ba84547c782504d23f6029fd2 Jul 21 20:16:21.936032 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Name: tempest-AttachVolumeNegativeTest-1294836183 Jul 21 20:16:21.936032 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Role: reader,member Jul 21 20:16:21.936032 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Roles: reader,member Jul 21 20:16:21.937631 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e0075f5ba84547c782504d23f6029fd2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e0075f5ba84547c782504d23f6029fd2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e0075f5ba84547c782504d23f6029fd2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e0075f5ba84547c782504d23f6029fd2"}]}] Jul 21 20:16:21.937631 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Tenant: tempest-AttachVolumeNegativeTest-1294836183 Jul 21 20:16:21.937631 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Tenant-Id: e0075f5ba84547c782504d23f6029fd2 Jul 21 20:16:21.937631 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1294836183 Jul 21 20:16:21.937631 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User: tempest-AttachVolumeNegativeTest-1294836183-project Jul 21 20:16:21.937631 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Domain-Id: default Jul 21 20:16:21.937631 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Domain-Name: Default Jul 21 20:16:21.937631 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Id: d04a0e68aea7424181f6c2728cbf7e3f Jul 21 20:16:21.937631 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Name: tempest-AttachVolumeNegativeTest-1294836183-project Jul 21 20:16:21.937631 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: method: > Jul 21 20:16:21.937631 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: exception: Instance 392749b4-22f6-470d-9b2e-4a9b2ded152b could not be found. Jul 21 20:16:21.937631 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: action_args: {'id': '392749b4-22f6-470d-9b2e-4a9b2ded152b'} Jul 21 20:16:21.939493 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 20:16:21.939493 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:16:21.939493 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 20:16:21.939493 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 20:16:21.939493 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 20:16:21.939493 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 20:16:21.939493 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 20:16:21.939493 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 20:16:21.939493 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 20:16:21.939493 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 20:16:21.939493 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 392749b4-22f6-470d-9b2e-4a9b2ded152b could not be found. Jul 21 20:16:21.939493 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:16:21.939493 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:16:21.939493 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:16:21.939493 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:16:21.939493 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:16:21.939493 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:16:21.939493 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 20:16:21.939493 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 20:16:21.939493 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 20:16:21.940906 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 20:16:21.940906 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 20:16:21.940906 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 20:16:21.940906 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 20:16:21.940906 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 20:16:21.940906 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 20:16:21.940906 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 20:16:21.940906 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 392749b4-22f6-470d-9b2e-4a9b2ded152b could not be found. Jul 21 20:16:21.940906 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:16:21.940906 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:16:21.940906 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:16:21.940906 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:16:21.940906 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:16:21.940906 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:16:21.940906 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 20:16:21.940906 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 20:16:21.940906 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 392749b4-22f6-470d-9b2e-4a9b2ded152b could not be found. Jul 21 20:16:21.940906 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:16:21.942127 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-8525b113-26fe-4f2c-a6f6-2dbaabd01311 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Returning 404 to user: Instance 392749b4-22f6-470d-9b2e-4a9b2ded152b could not be found. {{(pid=118344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 20:16:21.942127 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-8525b113-26fe-4f2c-a6f6-2dbaabd01311 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/392749b4-22f6-470d-9b2e-4a9b2ded152b" status: 404 len: 111 microversion: 2.1 time: 0.037229 Jul 21 20:16:21.942127 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 499/1023] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:16:21 2022] GET /compute/v2.1/servers/392749b4-22f6-470d-9b2e-4a9b2ded152b => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 20:16:22.060462 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-07e6a777-32a7-43be-ae1f-dec127556d4a tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6329f88fae384f20ad2f6aa66dc9864f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a0044f6e28474da9f3789f27654523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:16:22.068143 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-07e6a777-32a7-43be-ae1f-dec127556d4a tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] 10.222.0.58 "GET /compute/v2.1/servers/61231bf8-a454-4ae4-b94e-0193a0f45096" status: 200 len: 1504 microversion: 2.1 time: 0.155264 Jul 21 20:16:22.068706 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 525/1024] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:16:21 2022] GET /compute/v2.1/servers/61231bf8-a454-4ae4-b94e-0193a0f45096 => generated 1504 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:16:23.045107 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [req-a0242f4e-39fd-46d4-bdbf-040e96007b4e req-59cd8eba-0e31-4470-a9bc-c4b71d0a1450 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61231bf8-a454-4ae4-b94e-0193a0f45096", "name": "network-vif-deleted", "tag": "b7d66ba5-3ef5-4913-a529-1308eabeee5e"}]} {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:16:23.054760 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [req-a0242f4e-39fd-46d4-bdbf-040e96007b4e req-59cd8eba-0e31-4470-a9bc-c4b71d0a1450 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:23.060287 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [req-a0242f4e-39fd-46d4-bdbf-040e96007b4e req-59cd8eba-0e31-4470-a9bc-c4b71d0a1450 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:23.066398 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.compute.server_external_events [req-a0242f4e-39fd-46d4-bdbf-040e96007b4e req-59cd8eba-0e31-4470-a9bc-c4b71d0a1450 service nova] Creating event network-vif-deleted:b7d66ba5-3ef5-4913-a529-1308eabeee5e for instance 61231bf8-a454-4ae4-b94e-0193a0f45096 on hv-cinder-85054 Jul 21 20:16:23.071950 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [req-a0242f4e-39fd-46d4-bdbf-040e96007b4e req-59cd8eba-0e31-4470-a9bc-c4b71d0a1450 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030574 Jul 21 20:16:23.072597 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 500/1025] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 20:16:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:16:23.085354 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-99a7766c-84ca-4937-8ed8-ac1e7eef567f tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:16:23.085959 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-99a7766c-84ca-4937-8ed8-ac1e7eef567f tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] [instance: 61231bf8-a454-4ae4-b94e-0193a0f45096] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:16:23.092350 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-99a7766c-84ca-4937-8ed8-ac1e7eef567f tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:23.092785 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-99a7766c-84ca-4937-8ed8-ac1e7eef567f tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:23.093529 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-99a7766c-84ca-4937-8ed8-ac1e7eef567f tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:23.093955 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-99a7766c-84ca-4937-8ed8-ac1e7eef567f tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:23.156814 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-99a7766c-84ca-4937-8ed8-ac1e7eef567f tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6329f88fae384f20ad2f6aa66dc9864f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a0044f6e28474da9f3789f27654523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:16:23.164324 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-99a7766c-84ca-4937-8ed8-ac1e7eef567f tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] 10.222.0.58 "GET /compute/v2.1/servers/61231bf8-a454-4ae4-b94e-0193a0f45096" status: 200 len: 1462 microversion: 2.1 time: 0.083032 Jul 21 20:16:23.164937 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 526/1026] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:16:23 2022] GET /compute/v2.1/servers/61231bf8-a454-4ae4-b94e-0193a0f45096 => generated 1462 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:16:23.258220 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-73229f83-001f-4bc0-ae67-ba7a96424b9c tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:16:23.258809 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-73229f83-001f-4bc0-ae67-ba7a96424b9c tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: a41559e0-1fb6-44ef-97c1-36025e52fc48] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:16:23.265077 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-73229f83-001f-4bc0-ae67-ba7a96424b9c tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:23.265525 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-73229f83-001f-4bc0-ae67-ba7a96424b9c tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:23.266322 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-73229f83-001f-4bc0-ae67-ba7a96424b9c tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:23.266758 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-73229f83-001f-4bc0-ae67-ba7a96424b9c tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:23.280111 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.wsgi [None req-73229f83-001f-4bc0-ae67-ba7a96424b9c tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] HTTP exception thrown: Instance a41559e0-1fb6-44ef-97c1-36025e52fc48 could not be found. Jul 21 20:16:23.281795 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-73229f83-001f-4bc0-ae67-ba7a96424b9c tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Request method failure captured: Jul 21 20:16:23.281795 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: request: DELETE /compute/v2.1/servers/a41559e0-1fb6-44ef-97c1-36025e52fc48 HTTP/1.1 Jul 21 20:16:23.281795 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Accept: application/json Jul 21 20:16:23.281795 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Accept-Encoding: identity Jul 21 20:16:23.281795 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Connection: close Jul 21 20:16:23.281795 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Content-Length: 0 Jul 21 20:16:23.281795 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Content-Type: application/json Jul 21 20:16:23.281795 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Host: 10.222.0.58 Jul 21 20:16:23.281795 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Openstack-System-Scope: None Jul 21 20:16:23.281795 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: User-Agent: python-urllib3/1.26.9 Jul 21 20:16:23.281795 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Auth-Token: gAAAAABi2bFjKCUxQrNdZsEJV1kBJFiLgTT1Ekl7oj8yg_h_7YxyA7duEHuPdhQkp4Jd1ksQT4I6f50cht2hanCT9gvKpkDXVC1Uog_MnmqMteApPkGCv4CO2lrQc2eP7fSnvkh1csaG9QP2Dj0psWvWObuaYy8zQZsTJEhGK2eg_fgoqVDBHDI Jul 21 20:16:23.281795 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Domain-Id: None Jul 21 20:16:23.281795 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Domain-Name: None Jul 21 20:16:23.281795 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Identity-Status: Confirmed Jul 21 20:16:23.281795 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Is-Admin-Project: True Jul 21 20:16:23.281795 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Domain-Id: default Jul 21 20:16:23.281795 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Domain-Name: Default Jul 21 20:16:23.281795 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Id: e0075f5ba84547c782504d23f6029fd2 Jul 21 20:16:23.281795 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Name: tempest-AttachVolumeNegativeTest-1294836183 Jul 21 20:16:23.281795 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Role: reader,member Jul 21 20:16:23.281795 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Roles: reader,member Jul 21 20:16:23.283358 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e0075f5ba84547c782504d23f6029fd2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e0075f5ba84547c782504d23f6029fd2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e0075f5ba84547c782504d23f6029fd2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e0075f5ba84547c782504d23f6029fd2"}]}] Jul 21 20:16:23.283358 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Tenant: tempest-AttachVolumeNegativeTest-1294836183 Jul 21 20:16:23.283358 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Tenant-Id: e0075f5ba84547c782504d23f6029fd2 Jul 21 20:16:23.283358 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1294836183 Jul 21 20:16:23.283358 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User: tempest-AttachVolumeNegativeTest-1294836183-project Jul 21 20:16:23.283358 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Domain-Id: default Jul 21 20:16:23.283358 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Domain-Name: Default Jul 21 20:16:23.283358 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Id: d04a0e68aea7424181f6c2728cbf7e3f Jul 21 20:16:23.283358 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Name: tempest-AttachVolumeNegativeTest-1294836183-project Jul 21 20:16:23.283358 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: method: > Jul 21 20:16:23.283358 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: exception: Instance a41559e0-1fb6-44ef-97c1-36025e52fc48 could not be found. Jul 21 20:16:23.283358 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: action_args: {'id': 'a41559e0-1fb6-44ef-97c1-36025e52fc48'} Jul 21 20:16:23.284176 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 20:16:23.284176 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:16:23.284176 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 20:16:23.284176 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 20:16:23.284176 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 20:16:23.284176 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 20:16:23.284176 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 20:16:23.284176 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 20:16:23.284176 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 20:16:23.284176 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 20:16:23.284176 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a41559e0-1fb6-44ef-97c1-36025e52fc48 could not be found. Jul 21 20:16:23.284176 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:16:23.284176 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:16:23.284176 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:16:23.284176 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:16:23.284176 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:16:23.284176 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:16:23.284176 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 20:16:23.284176 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 20:16:23.284176 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 20:16:23.285614 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 20:16:23.285614 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 20:16:23.285614 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 20:16:23.285614 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 20:16:23.285614 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 20:16:23.285614 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 20:16:23.285614 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 20:16:23.285614 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 20:16:23.285614 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 20:16:23.285614 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a41559e0-1fb6-44ef-97c1-36025e52fc48 could not be found. Jul 21 20:16:23.285614 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:16:23.285614 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:16:23.285614 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:16:23.285614 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:16:23.285614 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:16:23.285614 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:16:23.285614 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 20:16:23.285614 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 20:16:23.285614 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a41559e0-1fb6-44ef-97c1-36025e52fc48 could not be found. Jul 21 20:16:23.285614 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:16:23.287536 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-73229f83-001f-4bc0-ae67-ba7a96424b9c tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Returning 404 to user: Instance a41559e0-1fb6-44ef-97c1-36025e52fc48 could not be found. {{(pid=118344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 20:16:23.287536 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-73229f83-001f-4bc0-ae67-ba7a96424b9c tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a41559e0-1fb6-44ef-97c1-36025e52fc48" status: 404 len: 111 microversion: 2.1 time: 0.030053 Jul 21 20:16:23.287536 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 501/1027] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Jul 21 20:16:23 2022] DELETE /compute/v2.1/servers/a41559e0-1fb6-44ef-97c1-36025e52fc48 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 20:16:23.292334 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-2e48d346-32ce-4194-864e-7926d61a4725 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:16:23.295591 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-2e48d346-32ce-4194-864e-7926d61a4725 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: a41559e0-1fb6-44ef-97c1-36025e52fc48] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:16:23.298957 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2e48d346-32ce-4194-864e-7926d61a4725 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:23.299434 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2e48d346-32ce-4194-864e-7926d61a4725 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:23.300199 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2e48d346-32ce-4194-864e-7926d61a4725 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:23.300633 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2e48d346-32ce-4194-864e-7926d61a4725 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:23.314366 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.wsgi [None req-2e48d346-32ce-4194-864e-7926d61a4725 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] HTTP exception thrown: Instance a41559e0-1fb6-44ef-97c1-36025e52fc48 could not be found. Jul 21 20:16:23.315910 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-2e48d346-32ce-4194-864e-7926d61a4725 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Request method failure captured: Jul 21 20:16:23.315910 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: request: GET /compute/v2.1/servers/a41559e0-1fb6-44ef-97c1-36025e52fc48 HTTP/1.1 Jul 21 20:16:23.315910 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Accept: application/json Jul 21 20:16:23.315910 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Accept-Encoding: identity Jul 21 20:16:23.315910 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Connection: close Jul 21 20:16:23.315910 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Content-Length: 0 Jul 21 20:16:23.315910 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Content-Type: application/json Jul 21 20:16:23.315910 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Host: 10.222.0.58 Jul 21 20:16:23.315910 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Openstack-System-Scope: None Jul 21 20:16:23.315910 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: User-Agent: python-urllib3/1.26.9 Jul 21 20:16:23.315910 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Auth-Token: gAAAAABi2bFjKCUxQrNdZsEJV1kBJFiLgTT1Ekl7oj8yg_h_7YxyA7duEHuPdhQkp4Jd1ksQT4I6f50cht2hanCT9gvKpkDXVC1Uog_MnmqMteApPkGCv4CO2lrQc2eP7fSnvkh1csaG9QP2Dj0psWvWObuaYy8zQZsTJEhGK2eg_fgoqVDBHDI Jul 21 20:16:23.315910 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Domain-Id: None Jul 21 20:16:23.315910 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Domain-Name: None Jul 21 20:16:23.315910 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Identity-Status: Confirmed Jul 21 20:16:23.315910 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Is-Admin-Project: True Jul 21 20:16:23.315910 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Id: default Jul 21 20:16:23.315910 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Name: Default Jul 21 20:16:23.315910 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Id: e0075f5ba84547c782504d23f6029fd2 Jul 21 20:16:23.315910 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Name: tempest-AttachVolumeNegativeTest-1294836183 Jul 21 20:16:23.315910 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Role: reader,member Jul 21 20:16:23.315910 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Roles: reader,member Jul 21 20:16:23.317496 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e0075f5ba84547c782504d23f6029fd2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e0075f5ba84547c782504d23f6029fd2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e0075f5ba84547c782504d23f6029fd2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e0075f5ba84547c782504d23f6029fd2"}]}] Jul 21 20:16:23.317496 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Tenant: tempest-AttachVolumeNegativeTest-1294836183 Jul 21 20:16:23.317496 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Tenant-Id: e0075f5ba84547c782504d23f6029fd2 Jul 21 20:16:23.317496 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1294836183 Jul 21 20:16:23.317496 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User: tempest-AttachVolumeNegativeTest-1294836183-project Jul 21 20:16:23.317496 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Id: default Jul 21 20:16:23.317496 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Name: Default Jul 21 20:16:23.317496 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Id: d04a0e68aea7424181f6c2728cbf7e3f Jul 21 20:16:23.317496 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Name: tempest-AttachVolumeNegativeTest-1294836183-project Jul 21 20:16:23.317496 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: method: > Jul 21 20:16:23.317496 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: exception: Instance a41559e0-1fb6-44ef-97c1-36025e52fc48 could not be found. Jul 21 20:16:23.317496 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: action_args: {'id': 'a41559e0-1fb6-44ef-97c1-36025e52fc48'} Jul 21 20:16:23.318435 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 20:16:23.318435 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:16:23.318435 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 20:16:23.318435 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 20:16:23.318435 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 20:16:23.318435 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 20:16:23.318435 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 20:16:23.318435 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 20:16:23.318435 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 20:16:23.318435 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 20:16:23.318435 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a41559e0-1fb6-44ef-97c1-36025e52fc48 could not be found. Jul 21 20:16:23.318435 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:16:23.318435 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:16:23.318435 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:16:23.318435 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:16:23.318435 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:16:23.318435 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:16:23.318435 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 20:16:23.318435 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 20:16:23.318435 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 20:16:23.319857 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 20:16:23.319857 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 20:16:23.319857 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 20:16:23.319857 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 20:16:23.319857 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 20:16:23.319857 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 20:16:23.319857 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 20:16:23.319857 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a41559e0-1fb6-44ef-97c1-36025e52fc48 could not be found. Jul 21 20:16:23.319857 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:16:23.319857 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:16:23.319857 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:16:23.319857 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:16:23.319857 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:16:23.319857 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:16:23.319857 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 20:16:23.319857 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 20:16:23.319857 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a41559e0-1fb6-44ef-97c1-36025e52fc48 could not be found. Jul 21 20:16:23.319857 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:16:23.321126 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-2e48d346-32ce-4194-864e-7926d61a4725 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Returning 404 to user: Instance a41559e0-1fb6-44ef-97c1-36025e52fc48 could not be found. {{(pid=118345) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 20:16:23.321126 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-2e48d346-32ce-4194-864e-7926d61a4725 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/a41559e0-1fb6-44ef-97c1-36025e52fc48" status: 404 len: 111 microversion: 2.1 time: 0.028839 Jul 21 20:16:23.321126 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 527/1028] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:16:23 2022] GET /compute/v2.1/servers/a41559e0-1fb6-44ef-97c1-36025e52fc48 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 20:16:23.325865 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-e900510f-9436-4bca-8a18-ae1334f6e307 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:16:23.326359 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-e900510f-9436-4bca-8a18-ae1334f6e307 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 1c38827c-8adc-4201-ae50-94e43ffbb63a] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:16:23.332495 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-e900510f-9436-4bca-8a18-ae1334f6e307 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:23.332944 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-e900510f-9436-4bca-8a18-ae1334f6e307 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:23.333722 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-e900510f-9436-4bca-8a18-ae1334f6e307 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:23.334156 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-e900510f-9436-4bca-8a18-ae1334f6e307 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:23.347641 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.wsgi [None req-e900510f-9436-4bca-8a18-ae1334f6e307 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] HTTP exception thrown: Instance 1c38827c-8adc-4201-ae50-94e43ffbb63a could not be found. Jul 21 20:16:23.349667 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-e900510f-9436-4bca-8a18-ae1334f6e307 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Request method failure captured: Jul 21 20:16:23.349667 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: request: DELETE /compute/v2.1/servers/1c38827c-8adc-4201-ae50-94e43ffbb63a HTTP/1.1 Jul 21 20:16:23.349667 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Accept: application/json Jul 21 20:16:23.349667 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Accept-Encoding: identity Jul 21 20:16:23.349667 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Connection: close Jul 21 20:16:23.349667 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Content-Length: 0 Jul 21 20:16:23.349667 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Content-Type: application/json Jul 21 20:16:23.349667 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Host: 10.222.0.58 Jul 21 20:16:23.349667 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Openstack-System-Scope: None Jul 21 20:16:23.349667 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: User-Agent: python-urllib3/1.26.9 Jul 21 20:16:23.349667 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Auth-Token: gAAAAABi2bFjKCUxQrNdZsEJV1kBJFiLgTT1Ekl7oj8yg_h_7YxyA7duEHuPdhQkp4Jd1ksQT4I6f50cht2hanCT9gvKpkDXVC1Uog_MnmqMteApPkGCv4CO2lrQc2eP7fSnvkh1csaG9QP2Dj0psWvWObuaYy8zQZsTJEhGK2eg_fgoqVDBHDI Jul 21 20:16:23.349667 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Domain-Id: None Jul 21 20:16:23.349667 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Domain-Name: None Jul 21 20:16:23.349667 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Identity-Status: Confirmed Jul 21 20:16:23.349667 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Is-Admin-Project: True Jul 21 20:16:23.349667 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Domain-Id: default Jul 21 20:16:23.349667 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Domain-Name: Default Jul 21 20:16:23.349667 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Id: e0075f5ba84547c782504d23f6029fd2 Jul 21 20:16:23.349667 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Name: tempest-AttachVolumeNegativeTest-1294836183 Jul 21 20:16:23.349667 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Role: reader,member Jul 21 20:16:23.349667 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Roles: reader,member Jul 21 20:16:23.352801 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e0075f5ba84547c782504d23f6029fd2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e0075f5ba84547c782504d23f6029fd2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e0075f5ba84547c782504d23f6029fd2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e0075f5ba84547c782504d23f6029fd2"}]}] Jul 21 20:16:23.352801 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Tenant: tempest-AttachVolumeNegativeTest-1294836183 Jul 21 20:16:23.352801 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Tenant-Id: e0075f5ba84547c782504d23f6029fd2 Jul 21 20:16:23.352801 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1294836183 Jul 21 20:16:23.352801 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User: tempest-AttachVolumeNegativeTest-1294836183-project Jul 21 20:16:23.352801 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Domain-Id: default Jul 21 20:16:23.352801 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Domain-Name: Default Jul 21 20:16:23.352801 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Id: d04a0e68aea7424181f6c2728cbf7e3f Jul 21 20:16:23.352801 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Name: tempest-AttachVolumeNegativeTest-1294836183-project Jul 21 20:16:23.352801 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: method: > Jul 21 20:16:23.352801 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: exception: Instance 1c38827c-8adc-4201-ae50-94e43ffbb63a could not be found. Jul 21 20:16:23.352801 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: action_args: {'id': '1c38827c-8adc-4201-ae50-94e43ffbb63a'} Jul 21 20:16:23.353650 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 20:16:23.353650 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:16:23.353650 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 20:16:23.353650 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 20:16:23.353650 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 20:16:23.353650 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 20:16:23.353650 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 20:16:23.353650 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 20:16:23.353650 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 20:16:23.353650 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 20:16:23.353650 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c38827c-8adc-4201-ae50-94e43ffbb63a could not be found. Jul 21 20:16:23.353650 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:16:23.353650 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:16:23.353650 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:16:23.353650 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:16:23.353650 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:16:23.353650 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:16:23.353650 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 20:16:23.353650 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 20:16:23.353650 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 20:16:23.355073 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 20:16:23.355073 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 20:16:23.355073 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 20:16:23.355073 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 20:16:23.355073 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 20:16:23.355073 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 20:16:23.355073 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 20:16:23.355073 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 20:16:23.355073 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 20:16:23.355073 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c38827c-8adc-4201-ae50-94e43ffbb63a could not be found. Jul 21 20:16:23.355073 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:16:23.355073 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:16:23.355073 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:16:23.355073 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:16:23.355073 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:16:23.355073 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:16:23.355073 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 20:16:23.355073 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 20:16:23.355073 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c38827c-8adc-4201-ae50-94e43ffbb63a could not be found. Jul 21 20:16:23.355073 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:16:23.356495 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-e900510f-9436-4bca-8a18-ae1334f6e307 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Returning 404 to user: Instance 1c38827c-8adc-4201-ae50-94e43ffbb63a could not be found. {{(pid=118344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 20:16:23.356495 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-e900510f-9436-4bca-8a18-ae1334f6e307 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "DELETE /compute/v2.1/servers/1c38827c-8adc-4201-ae50-94e43ffbb63a" status: 404 len: 111 microversion: 2.1 time: 0.029002 Jul 21 20:16:23.356495 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 502/1029] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Jul 21 20:16:23 2022] DELETE /compute/v2.1/servers/1c38827c-8adc-4201-ae50-94e43ffbb63a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 20:16:23.359322 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-8ccf59bb-5f90-4388-9c02-55a58e9ed0e9 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:16:23.359932 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-8ccf59bb-5f90-4388-9c02-55a58e9ed0e9 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 1c38827c-8adc-4201-ae50-94e43ffbb63a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:16:23.366537 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8ccf59bb-5f90-4388-9c02-55a58e9ed0e9 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:23.366982 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8ccf59bb-5f90-4388-9c02-55a58e9ed0e9 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:23.367770 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8ccf59bb-5f90-4388-9c02-55a58e9ed0e9 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:23.368205 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8ccf59bb-5f90-4388-9c02-55a58e9ed0e9 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:23.381567 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.wsgi [None req-8ccf59bb-5f90-4388-9c02-55a58e9ed0e9 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] HTTP exception thrown: Instance 1c38827c-8adc-4201-ae50-94e43ffbb63a could not be found. Jul 21 20:16:23.383098 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-8ccf59bb-5f90-4388-9c02-55a58e9ed0e9 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Request method failure captured: Jul 21 20:16:23.383098 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: request: GET /compute/v2.1/servers/1c38827c-8adc-4201-ae50-94e43ffbb63a HTTP/1.1 Jul 21 20:16:23.383098 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Accept: application/json Jul 21 20:16:23.383098 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Accept-Encoding: identity Jul 21 20:16:23.383098 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Connection: close Jul 21 20:16:23.383098 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Content-Length: 0 Jul 21 20:16:23.383098 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Content-Type: application/json Jul 21 20:16:23.383098 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Host: 10.222.0.58 Jul 21 20:16:23.383098 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Openstack-System-Scope: None Jul 21 20:16:23.383098 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: User-Agent: python-urllib3/1.26.9 Jul 21 20:16:23.383098 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Auth-Token: gAAAAABi2bFjKCUxQrNdZsEJV1kBJFiLgTT1Ekl7oj8yg_h_7YxyA7duEHuPdhQkp4Jd1ksQT4I6f50cht2hanCT9gvKpkDXVC1Uog_MnmqMteApPkGCv4CO2lrQc2eP7fSnvkh1csaG9QP2Dj0psWvWObuaYy8zQZsTJEhGK2eg_fgoqVDBHDI Jul 21 20:16:23.383098 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Domain-Id: None Jul 21 20:16:23.383098 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Domain-Name: None Jul 21 20:16:23.383098 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Identity-Status: Confirmed Jul 21 20:16:23.383098 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Is-Admin-Project: True Jul 21 20:16:23.383098 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Id: default Jul 21 20:16:23.383098 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Name: Default Jul 21 20:16:23.383098 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Id: e0075f5ba84547c782504d23f6029fd2 Jul 21 20:16:23.383098 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Name: tempest-AttachVolumeNegativeTest-1294836183 Jul 21 20:16:23.383098 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Role: reader,member Jul 21 20:16:23.383098 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Roles: reader,member Jul 21 20:16:23.384663 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e0075f5ba84547c782504d23f6029fd2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e0075f5ba84547c782504d23f6029fd2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e0075f5ba84547c782504d23f6029fd2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e0075f5ba84547c782504d23f6029fd2"}]}] Jul 21 20:16:23.384663 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Tenant: tempest-AttachVolumeNegativeTest-1294836183 Jul 21 20:16:23.384663 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Tenant-Id: e0075f5ba84547c782504d23f6029fd2 Jul 21 20:16:23.384663 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1294836183 Jul 21 20:16:23.384663 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User: tempest-AttachVolumeNegativeTest-1294836183-project Jul 21 20:16:23.384663 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Id: default Jul 21 20:16:23.384663 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Name: Default Jul 21 20:16:23.384663 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Id: d04a0e68aea7424181f6c2728cbf7e3f Jul 21 20:16:23.384663 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Name: tempest-AttachVolumeNegativeTest-1294836183-project Jul 21 20:16:23.384663 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: method: > Jul 21 20:16:23.384663 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: exception: Instance 1c38827c-8adc-4201-ae50-94e43ffbb63a could not be found. Jul 21 20:16:23.384663 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: action_args: {'id': '1c38827c-8adc-4201-ae50-94e43ffbb63a'} Jul 21 20:16:23.385524 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 20:16:23.385524 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:16:23.385524 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 20:16:23.385524 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 20:16:23.385524 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 20:16:23.385524 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 20:16:23.385524 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 20:16:23.385524 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 20:16:23.385524 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 20:16:23.385524 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 20:16:23.385524 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c38827c-8adc-4201-ae50-94e43ffbb63a could not be found. Jul 21 20:16:23.385524 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:16:23.385524 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:16:23.385524 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:16:23.385524 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:16:23.385524 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:16:23.385524 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:16:23.385524 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 20:16:23.385524 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 20:16:23.385524 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 20:16:23.386958 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 20:16:23.386958 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 20:16:23.386958 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 20:16:23.386958 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 20:16:23.386958 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 20:16:23.386958 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 20:16:23.386958 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 20:16:23.386958 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c38827c-8adc-4201-ae50-94e43ffbb63a could not be found. Jul 21 20:16:23.386958 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:16:23.386958 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:16:23.386958 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:16:23.386958 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:16:23.386958 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:16:23.386958 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:16:23.386958 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 20:16:23.386958 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 20:16:23.386958 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c38827c-8adc-4201-ae50-94e43ffbb63a could not be found. Jul 21 20:16:23.386958 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:16:23.388251 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-8ccf59bb-5f90-4388-9c02-55a58e9ed0e9 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Returning 404 to user: Instance 1c38827c-8adc-4201-ae50-94e43ffbb63a could not be found. {{(pid=118345) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 20:16:23.388251 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-8ccf59bb-5f90-4388-9c02-55a58e9ed0e9 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/1c38827c-8adc-4201-ae50-94e43ffbb63a" status: 404 len: 111 microversion: 2.1 time: 0.028950 Jul 21 20:16:23.388251 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 528/1030] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:16:23 2022] GET /compute/v2.1/servers/1c38827c-8adc-4201-ae50-94e43ffbb63a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 20:16:24.181737 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-a199ab90-69a0-4fa5-baaa-a9ced4b1bac9 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:16:24.182317 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-a199ab90-69a0-4fa5-baaa-a9ced4b1bac9 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] [instance: 61231bf8-a454-4ae4-b94e-0193a0f45096] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:16:24.188807 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-a199ab90-69a0-4fa5-baaa-a9ced4b1bac9 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:24.189257 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-a199ab90-69a0-4fa5-baaa-a9ced4b1bac9 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:24.190018 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-a199ab90-69a0-4fa5-baaa-a9ced4b1bac9 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:24.190458 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-a199ab90-69a0-4fa5-baaa-a9ced4b1bac9 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:24.203962 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.wsgi [None req-a199ab90-69a0-4fa5-baaa-a9ced4b1bac9 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] HTTP exception thrown: Instance 61231bf8-a454-4ae4-b94e-0193a0f45096 could not be found. Jul 21 20:16:24.205482 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-a199ab90-69a0-4fa5-baaa-a9ced4b1bac9 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Request method failure captured: Jul 21 20:16:24.205482 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: request: GET /compute/v2.1/servers/61231bf8-a454-4ae4-b94e-0193a0f45096 HTTP/1.1 Jul 21 20:16:24.205482 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Accept: application/json Jul 21 20:16:24.205482 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Accept-Encoding: identity Jul 21 20:16:24.205482 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Connection: close Jul 21 20:16:24.205482 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Content-Length: 0 Jul 21 20:16:24.205482 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Content-Type: application/json Jul 21 20:16:24.205482 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Host: 10.222.0.58 Jul 21 20:16:24.205482 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Openstack-System-Scope: None Jul 21 20:16:24.205482 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: User-Agent: python-urllib3/1.26.9 Jul 21 20:16:24.205482 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Auth-Token: gAAAAABi2bQD5vDsAzTcLKy-zAl7CcnO2XucZG2v796Wim_bUl9rgCL8a6F2rjSku4TB3o2zu0WhFhmDtSvoXcxdreEo00rc8rK5MAh_xqIIe3JRxcNG1sOXPi2YuaS8tKctrsjPRD4ZmPjNsohBt1X8T_YTc2S3CHFI60HTiZf17HGK3923Xho Jul 21 20:16:24.205482 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Domain-Id: None Jul 21 20:16:24.205482 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Domain-Name: None Jul 21 20:16:24.205482 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Identity-Status: Confirmed Jul 21 20:16:24.205482 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Is-Admin-Project: True Jul 21 20:16:24.205482 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Domain-Id: default Jul 21 20:16:24.205482 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Domain-Name: Default Jul 21 20:16:24.205482 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Id: d7a0044f6e28474da9f3789f27654523 Jul 21 20:16:24.205482 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Name: tempest-VolumesActionsTest-286079502 Jul 21 20:16:24.205482 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Role: reader,member Jul 21 20:16:24.205482 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Roles: reader,member Jul 21 20:16:24.207146 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d7a0044f6e28474da9f3789f27654523"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d7a0044f6e28474da9f3789f27654523"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d7a0044f6e28474da9f3789f27654523"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d7a0044f6e28474da9f3789f27654523"}]}] Jul 21 20:16:24.207146 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Tenant: tempest-VolumesActionsTest-286079502 Jul 21 20:16:24.207146 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Tenant-Id: d7a0044f6e28474da9f3789f27654523 Jul 21 20:16:24.207146 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Tenant-Name: tempest-VolumesActionsTest-286079502 Jul 21 20:16:24.207146 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User: tempest-VolumesActionsTest-286079502-project Jul 21 20:16:24.207146 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Domain-Id: default Jul 21 20:16:24.207146 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Domain-Name: Default Jul 21 20:16:24.207146 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Id: 6329f88fae384f20ad2f6aa66dc9864f Jul 21 20:16:24.207146 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Name: tempest-VolumesActionsTest-286079502-project Jul 21 20:16:24.207146 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: method: > Jul 21 20:16:24.207146 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: exception: Instance 61231bf8-a454-4ae4-b94e-0193a0f45096 could not be found. Jul 21 20:16:24.207146 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: action_args: {'id': '61231bf8-a454-4ae4-b94e-0193a0f45096'} Jul 21 20:16:24.208248 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 20:16:24.208248 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:16:24.208248 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 20:16:24.208248 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 20:16:24.208248 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 20:16:24.208248 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 20:16:24.208248 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 20:16:24.208248 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 20:16:24.208248 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 20:16:24.208248 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 20:16:24.208248 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61231bf8-a454-4ae4-b94e-0193a0f45096 could not be found. Jul 21 20:16:24.208248 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:16:24.208248 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:16:24.208248 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:16:24.208248 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:16:24.208248 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:16:24.208248 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:16:24.208248 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 20:16:24.208248 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 20:16:24.208248 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 20:16:24.210237 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 20:16:24.210237 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 20:16:24.210237 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 20:16:24.210237 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 20:16:24.210237 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 20:16:24.210237 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 20:16:24.210237 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 20:16:24.210237 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61231bf8-a454-4ae4-b94e-0193a0f45096 could not be found. Jul 21 20:16:24.210237 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:16:24.210237 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:16:24.210237 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:16:24.210237 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:16:24.210237 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:16:24.210237 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:16:24.210237 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 20:16:24.210237 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 20:16:24.210237 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61231bf8-a454-4ae4-b94e-0193a0f45096 could not be found. Jul 21 20:16:24.210237 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:16:24.211571 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-a199ab90-69a0-4fa5-baaa-a9ced4b1bac9 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Returning 404 to user: Instance 61231bf8-a454-4ae4-b94e-0193a0f45096 could not be found. {{(pid=118344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 20:16:24.211571 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-a199ab90-69a0-4fa5-baaa-a9ced4b1bac9 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] 10.222.0.58 "GET /compute/v2.1/servers/61231bf8-a454-4ae4-b94e-0193a0f45096" status: 404 len: 111 microversion: 2.1 time: 0.029183 Jul 21 20:16:24.211571 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 503/1031] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:16:24 2022] GET /compute/v2.1/servers/61231bf8-a454-4ae4-b94e-0193a0f45096 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 20:16:24.305028 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-91c45e12-a655-43df-9429-d8c5bab8a0c1 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1287617655", "imageRef": "357a1479-6cbd-4882-8d3f-d945fa40e6df", "flavorRef": "452", "networks": [{"uuid": "e5121a6f-4921-46c5-948e-b10277e46b21"}]}} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:16:24.356590 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.network.neutron [None req-91c45e12-a655-43df-9429-d8c5bab8a0c1 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] validate_networks() for [('e5121a6f-4921-46c5-948e-b10277e46b21', None, None, None, None, None)] {{(pid=118345) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 20:16:24.495088 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-8ff007e6-e321-4656-80cc-b1236b090bb9 tempest-VolumesTestJSON-672841738 tempest-VolumesTestJSON-672841738-project] Calling method '.version_select at 0x7f351cb2a3a0>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:16:24.541675 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-8ff007e6-e321-4656-80cc-b1236b090bb9 tempest-VolumesTestJSON-672841738 tempest-VolumesTestJSON-672841738-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/a7c2a118-f65a-4d6e-9a70-08461ead5825" status: 200 len: 351 microversion: 2.1 time: 0.050278 Jul 21 20:16:24.542238 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 504/1032] 10.222.0.58 () {58 vars in 1244 bytes} [Thu Jul 21 20:16:24 2022] GET /compute/v2.1/os-volumes/a7c2a118-f65a-4d6e-9a70-08461ead5825 => generated 351 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 20:16:24.687610 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-8f2c6e71-b5ef-439e-b010-b1ec678186e8 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:16:24.692484 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-8f2c6e71-b5ef-439e-b010-b1ec678186e8 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 8f00566b-862b-4171-9259-b12aaa7ea030] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:16:24.694749 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-8f2c6e71-b5ef-439e-b010-b1ec678186e8 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:24.695225 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-8f2c6e71-b5ef-439e-b010-b1ec678186e8 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:24.696044 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-8f2c6e71-b5ef-439e-b010-b1ec678186e8 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:24.696411 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-8f2c6e71-b5ef-439e-b010-b1ec678186e8 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:24.709893 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.wsgi [None req-8f2c6e71-b5ef-439e-b010-b1ec678186e8 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] HTTP exception thrown: Instance 8f00566b-862b-4171-9259-b12aaa7ea030 could not be found. Jul 21 20:16:24.711465 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-8f2c6e71-b5ef-439e-b010-b1ec678186e8 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Request method failure captured: Jul 21 20:16:24.711465 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: request: DELETE /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030 HTTP/1.1 Jul 21 20:16:24.711465 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Accept: application/json Jul 21 20:16:24.711465 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Accept-Encoding: identity Jul 21 20:16:24.711465 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Connection: close Jul 21 20:16:24.711465 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Content-Length: 0 Jul 21 20:16:24.711465 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Content-Type: application/json Jul 21 20:16:24.711465 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Host: 10.222.0.58 Jul 21 20:16:24.711465 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Openstack-System-Scope: None Jul 21 20:16:24.711465 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: User-Agent: python-urllib3/1.26.9 Jul 21 20:16:24.711465 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Auth-Token: gAAAAABi2bFjKCUxQrNdZsEJV1kBJFiLgTT1Ekl7oj8yg_h_7YxyA7duEHuPdhQkp4Jd1ksQT4I6f50cht2hanCT9gvKpkDXVC1Uog_MnmqMteApPkGCv4CO2lrQc2eP7fSnvkh1csaG9QP2Dj0psWvWObuaYy8zQZsTJEhGK2eg_fgoqVDBHDI Jul 21 20:16:24.711465 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Domain-Id: None Jul 21 20:16:24.711465 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Domain-Name: None Jul 21 20:16:24.711465 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Identity-Status: Confirmed Jul 21 20:16:24.711465 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Is-Admin-Project: True Jul 21 20:16:24.711465 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Domain-Id: default Jul 21 20:16:24.711465 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Domain-Name: Default Jul 21 20:16:24.711465 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Id: e0075f5ba84547c782504d23f6029fd2 Jul 21 20:16:24.711465 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Name: tempest-AttachVolumeNegativeTest-1294836183 Jul 21 20:16:24.711465 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Role: reader,member Jul 21 20:16:24.711465 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Roles: reader,member Jul 21 20:16:24.712797 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e0075f5ba84547c782504d23f6029fd2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e0075f5ba84547c782504d23f6029fd2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e0075f5ba84547c782504d23f6029fd2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e0075f5ba84547c782504d23f6029fd2"}]}] Jul 21 20:16:24.712797 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Tenant: tempest-AttachVolumeNegativeTest-1294836183 Jul 21 20:16:24.712797 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Tenant-Id: e0075f5ba84547c782504d23f6029fd2 Jul 21 20:16:24.712797 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1294836183 Jul 21 20:16:24.712797 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User: tempest-AttachVolumeNegativeTest-1294836183-project Jul 21 20:16:24.712797 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Domain-Id: default Jul 21 20:16:24.712797 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Domain-Name: Default Jul 21 20:16:24.712797 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Id: d04a0e68aea7424181f6c2728cbf7e3f Jul 21 20:16:24.712797 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Name: tempest-AttachVolumeNegativeTest-1294836183-project Jul 21 20:16:24.712797 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: method: > Jul 21 20:16:24.712797 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: exception: Instance 8f00566b-862b-4171-9259-b12aaa7ea030 could not be found. Jul 21 20:16:24.712797 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: action_args: {'id': '8f00566b-862b-4171-9259-b12aaa7ea030'} Jul 21 20:16:24.714083 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 20:16:24.714083 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:16:24.714083 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 20:16:24.714083 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 20:16:24.714083 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 20:16:24.714083 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 20:16:24.714083 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 20:16:24.714083 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 20:16:24.714083 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 20:16:24.714083 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 20:16:24.714083 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f00566b-862b-4171-9259-b12aaa7ea030 could not be found. Jul 21 20:16:24.714083 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:16:24.714083 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:16:24.714083 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:16:24.714083 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:16:24.714083 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:16:24.714083 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:16:24.714083 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 20:16:24.714083 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 20:16:24.714083 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 20:16:24.715303 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 20:16:24.715303 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 20:16:24.715303 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 20:16:24.715303 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 20:16:24.715303 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 20:16:24.715303 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 20:16:24.715303 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 20:16:24.715303 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 20:16:24.715303 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 20:16:24.715303 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f00566b-862b-4171-9259-b12aaa7ea030 could not be found. Jul 21 20:16:24.715303 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:16:24.715303 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:16:24.715303 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:16:24.715303 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:16:24.715303 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:16:24.715303 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:16:24.715303 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 20:16:24.715303 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 20:16:24.715303 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f00566b-862b-4171-9259-b12aaa7ea030 could not be found. Jul 21 20:16:24.715303 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:16:24.716758 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-8f2c6e71-b5ef-439e-b010-b1ec678186e8 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Returning 404 to user: Instance 8f00566b-862b-4171-9259-b12aaa7ea030 could not be found. {{(pid=118344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 20:16:24.716758 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-8f2c6e71-b5ef-439e-b010-b1ec678186e8 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "DELETE /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030" status: 404 len: 111 microversion: 2.1 time: 0.029186 Jul 21 20:16:24.716758 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 505/1033] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Jul 21 20:16:24 2022] DELETE /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 20:16:24.721128 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-9e5d3c06-2cdb-45fd-85dc-be48ee6f7d64 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:16:24.721994 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-9e5d3c06-2cdb-45fd-85dc-be48ee6f7d64 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] [instance: 8f00566b-862b-4171-9259-b12aaa7ea030] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:16:24.727551 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-91c45e12-a655-43df-9429-d8c5bab8a0c1 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Flavor limits 0:0:0 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 20:16:24.727962 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-91c45e12-a655-43df-9429-d8c5bab8a0c1 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Image limits 0:0:0 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 20:16:24.728239 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-9e5d3c06-2cdb-45fd-85dc-be48ee6f7d64 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:24.728428 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-91c45e12-a655-43df-9429-d8c5bab8a0c1 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Flavor pref 0:0:0 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 20:16:24.728694 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-9e5d3c06-2cdb-45fd-85dc-be48ee6f7d64 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:24.728817 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-91c45e12-a655-43df-9429-d8c5bab8a0c1 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Image pref 0:0:0 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 20:16:24.729239 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-91c45e12-a655-43df-9429-d8c5bab8a0c1 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 20:16:24.729464 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-9e5d3c06-2cdb-45fd-85dc-be48ee6f7d64 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:24.729902 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-9e5d3c06-2cdb-45fd-85dc-be48ee6f7d64 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:24.738525 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-91c45e12-a655-43df-9429-d8c5bab8a0c1 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:24.739009 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-91c45e12-a655-43df-9429-d8c5bab8a0c1 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:24.740401 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-91c45e12-a655-43df-9429-d8c5bab8a0c1 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:24.741016 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-91c45e12-a655-43df-9429-d8c5bab8a0c1 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:24.744794 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.wsgi [None req-9e5d3c06-2cdb-45fd-85dc-be48ee6f7d64 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] HTTP exception thrown: Instance 8f00566b-862b-4171-9259-b12aaa7ea030 could not be found. Jul 21 20:16:24.746319 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-9e5d3c06-2cdb-45fd-85dc-be48ee6f7d64 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Request method failure captured: Jul 21 20:16:24.746319 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: request: GET /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030 HTTP/1.1 Jul 21 20:16:24.746319 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Accept: application/json Jul 21 20:16:24.746319 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Accept-Encoding: identity Jul 21 20:16:24.746319 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Connection: close Jul 21 20:16:24.746319 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Content-Length: 0 Jul 21 20:16:24.746319 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Content-Type: application/json Jul 21 20:16:24.746319 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Host: 10.222.0.58 Jul 21 20:16:24.746319 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Openstack-System-Scope: None Jul 21 20:16:24.746319 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: User-Agent: python-urllib3/1.26.9 Jul 21 20:16:24.746319 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Auth-Token: gAAAAABi2bFjKCUxQrNdZsEJV1kBJFiLgTT1Ekl7oj8yg_h_7YxyA7duEHuPdhQkp4Jd1ksQT4I6f50cht2hanCT9gvKpkDXVC1Uog_MnmqMteApPkGCv4CO2lrQc2eP7fSnvkh1csaG9QP2Dj0psWvWObuaYy8zQZsTJEhGK2eg_fgoqVDBHDI Jul 21 20:16:24.746319 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Domain-Id: None Jul 21 20:16:24.746319 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Domain-Name: None Jul 21 20:16:24.746319 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Identity-Status: Confirmed Jul 21 20:16:24.746319 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Is-Admin-Project: True Jul 21 20:16:24.746319 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Domain-Id: default Jul 21 20:16:24.746319 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Domain-Name: Default Jul 21 20:16:24.746319 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Id: e0075f5ba84547c782504d23f6029fd2 Jul 21 20:16:24.746319 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Name: tempest-AttachVolumeNegativeTest-1294836183 Jul 21 20:16:24.746319 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Role: reader,member Jul 21 20:16:24.746319 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Roles: reader,member Jul 21 20:16:24.748120 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e0075f5ba84547c782504d23f6029fd2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e0075f5ba84547c782504d23f6029fd2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e0075f5ba84547c782504d23f6029fd2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e0075f5ba84547c782504d23f6029fd2"}]}] Jul 21 20:16:24.748120 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Tenant: tempest-AttachVolumeNegativeTest-1294836183 Jul 21 20:16:24.748120 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Tenant-Id: e0075f5ba84547c782504d23f6029fd2 Jul 21 20:16:24.748120 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1294836183 Jul 21 20:16:24.748120 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User: tempest-AttachVolumeNegativeTest-1294836183-project Jul 21 20:16:24.748120 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Domain-Id: default Jul 21 20:16:24.748120 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Domain-Name: Default Jul 21 20:16:24.748120 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Id: d04a0e68aea7424181f6c2728cbf7e3f Jul 21 20:16:24.748120 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Name: tempest-AttachVolumeNegativeTest-1294836183-project Jul 21 20:16:24.748120 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: method: > Jul 21 20:16:24.748120 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: exception: Instance 8f00566b-862b-4171-9259-b12aaa7ea030 could not be found. Jul 21 20:16:24.748120 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: action_args: {'id': '8f00566b-862b-4171-9259-b12aaa7ea030'} Jul 21 20:16:24.750558 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 20:16:24.750558 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:16:24.750558 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 20:16:24.750558 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 20:16:24.750558 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 20:16:24.750558 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 20:16:24.750558 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 20:16:24.750558 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 20:16:24.750558 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 20:16:24.750558 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 20:16:24.750558 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f00566b-862b-4171-9259-b12aaa7ea030 could not be found. Jul 21 20:16:24.750558 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:16:24.750558 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:16:24.750558 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:16:24.750558 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:16:24.750558 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:16:24.750558 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:16:24.750558 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 20:16:24.750558 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 20:16:24.750558 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 20:16:24.752041 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 20:16:24.752041 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 20:16:24.752041 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 20:16:24.752041 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 20:16:24.752041 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 20:16:24.752041 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 20:16:24.752041 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 20:16:24.752041 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f00566b-862b-4171-9259-b12aaa7ea030 could not be found. Jul 21 20:16:24.752041 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:16:24.752041 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:16:24.752041 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:16:24.752041 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:16:24.752041 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:16:24.752041 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:16:24.752041 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 20:16:24.752041 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 20:16:24.752041 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f00566b-862b-4171-9259-b12aaa7ea030 could not be found. Jul 21 20:16:24.752041 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:16:24.753317 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-9e5d3c06-2cdb-45fd-85dc-be48ee6f7d64 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] Returning 404 to user: Instance 8f00566b-862b-4171-9259-b12aaa7ea030 could not be found. {{(pid=118344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 20:16:24.753317 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-9e5d3c06-2cdb-45fd-85dc-be48ee6f7d64 tempest-AttachVolumeNegativeTest-1294836183 tempest-AttachVolumeNegativeTest-1294836183-project] 10.222.0.58 "GET /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030" status: 404 len: 111 microversion: 2.1 time: 0.030359 Jul 21 20:16:24.753317 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 506/1034] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:16:24 2022] GET /compute/v2.1/servers/8f00566b-862b-4171-9259-b12aaa7ea030 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 21 20:16:24.760976 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.quota [None req-91c45e12-a655-43df-9429-d8c5bab8a0c1 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Getting quotas for project d7a0044f6e28474da9f3789f27654523. Resources: {'instances', 'cores', 'ram'} {{(pid=118345) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 20:16:24.765037 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.quota [None req-91c45e12-a655-43df-9429-d8c5bab8a0c1 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Getting quotas for user 6329f88fae384f20ad2f6aa66dc9864f and project d7a0044f6e28474da9f3789f27654523. Resources: {'instances', 'cores', 'ram'} {{(pid=118345) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 20:16:24.776435 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-91c45e12-a655-43df-9429-d8c5bab8a0c1 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Going to run 1 instances... {{(pid=118345) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 20:16:24.778777 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-91c45e12-a655-43df-9429-d8c5bab8a0c1 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] [instance: 1daf616f-ebb1-4ffc-879b-abf65afca9bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='357a1479-6cbd-4882-8d3f-d945fa40e6df',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118345) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 20:16:24.873486 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-91c45e12-a655-43df-9429-d8c5bab8a0c1 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.572087 Jul 21 20:16:24.874138 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 529/1035] 10.222.0.58 () {60 vars in 1146 bytes} [Thu Jul 21 20:16:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 574 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 20:16:24.884553 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-58f82c79-ce25-4b2c-ac13-cd3c0b31967b tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:16:24.885174 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-58f82c79-ce25-4b2c-ac13-cd3c0b31967b tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] [instance: 1daf616f-ebb1-4ffc-879b-abf65afca9bf] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:16:24.952730 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-58f82c79-ce25-4b2c-ac13-cd3c0b31967b tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6329f88fae384f20ad2f6aa66dc9864f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a0044f6e28474da9f3789f27654523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:16:24.961498 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-58f82c79-ce25-4b2c-ac13-cd3c0b31967b tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] 10.222.0.58 "GET /compute/v2.1/servers/1daf616f-ebb1-4ffc-879b-abf65afca9bf" status: 200 len: 1214 microversion: 2.1 time: 0.080887 Jul 21 20:16:24.962078 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 507/1036] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:16:24 2022] GET /compute/v2.1/servers/1daf616f-ebb1-4ffc-879b-abf65afca9bf => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:16:25.987799 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-d47fdf35-bde1-4866-8959-92eb7fea6b78 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:16:25.988411 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-d47fdf35-bde1-4866-8959-92eb7fea6b78 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] [instance: 1daf616f-ebb1-4ffc-879b-abf65afca9bf] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:16:25.995746 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d47fdf35-bde1-4866-8959-92eb7fea6b78 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:25.996470 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d47fdf35-bde1-4866-8959-92eb7fea6b78 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:25.997418 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d47fdf35-bde1-4866-8959-92eb7fea6b78 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:25.998024 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d47fdf35-bde1-4866-8959-92eb7fea6b78 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:26.065545 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-d47fdf35-bde1-4866-8959-92eb7fea6b78 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6329f88fae384f20ad2f6aa66dc9864f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a0044f6e28474da9f3789f27654523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:16:26.073205 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-d47fdf35-bde1-4866-8959-92eb7fea6b78 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] 10.222.0.58 "GET /compute/v2.1/servers/1daf616f-ebb1-4ffc-879b-abf65afca9bf" status: 200 len: 1218 microversion: 2.1 time: 0.090484 Jul 21 20:16:26.073784 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 530/1037] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:16:25 2022] GET /compute/v2.1/servers/1daf616f-ebb1-4ffc-879b-abf65afca9bf => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:16:27.090027 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-b25ff865-1e27-4c3b-a8b5-ec7afba3147f tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:16:27.090747 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-b25ff865-1e27-4c3b-a8b5-ec7afba3147f tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] [instance: 1daf616f-ebb1-4ffc-879b-abf65afca9bf] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:16:27.098671 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-b25ff865-1e27-4c3b-a8b5-ec7afba3147f tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:27.099840 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-b25ff865-1e27-4c3b-a8b5-ec7afba3147f tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:27.100693 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-b25ff865-1e27-4c3b-a8b5-ec7afba3147f tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:27.101131 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-b25ff865-1e27-4c3b-a8b5-ec7afba3147f tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:27.209008 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-b25ff865-1e27-4c3b-a8b5-ec7afba3147f tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6329f88fae384f20ad2f6aa66dc9864f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a0044f6e28474da9f3789f27654523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:16:27.210828 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-499bfdc8-e548-47fc-bbf7-06a0a7988018 tempest-VolumesTestJSON-672841738 tempest-VolumesTestJSON-672841738-project] Calling method '.version_select at 0x7f351ccac670>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:16:27.221571 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-b25ff865-1e27-4c3b-a8b5-ec7afba3147f tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] 10.222.0.58 "GET /compute/v2.1/servers/1daf616f-ebb1-4ffc-879b-abf65afca9bf" status: 200 len: 1274 microversion: 2.1 time: 0.133958 Jul 21 20:16:27.222277 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 508/1038] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:16:27 2022] GET /compute/v2.1/servers/1daf616f-ebb1-4ffc-879b-abf65afca9bf => generated 1274 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:16:27.285163 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-499bfdc8-e548-47fc-bbf7-06a0a7988018 tempest-VolumesTestJSON-672841738 tempest-VolumesTestJSON-672841738-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/fa9d0eb5-224c-4d68-883b-86666ab38fe8" status: 200 len: 350 microversion: 2.1 time: 0.078014 Jul 21 20:16:27.285766 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 531/1039] 10.222.0.58 () {58 vars in 1244 bytes} [Thu Jul 21 20:16:27 2022] GET /compute/v2.1/os-volumes/fa9d0eb5-224c-4d68-883b-86666ab38fe8 => generated 350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:16:27.298224 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-aefeccde-2414-42ad-b4f6-bddba8736e69 tempest-VolumesTestJSON-672841738 tempest-VolumesTestJSON-672841738-project] Calling method '.version_select at 0x7f351d0a1040>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:16:27.391353 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-aefeccde-2414-42ad-b4f6-bddba8736e69 tempest-VolumesTestJSON-672841738 tempest-VolumesTestJSON-672841738-project] 10.222.0.58 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.095813 Jul 21 20:16:27.391743 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 509/1040] 10.222.0.58 () {58 vars in 1133 bytes} [Thu Jul 21 20:16:27 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:16:27.408167 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-cb539e1a-439b-49c9-976f-026b4e0cce2c tempest-VolumesTestJSON-672841738 tempest-VolumesTestJSON-672841738-project] Calling method '.version_select at 0x7f351cc0ca60>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:16:27.493104 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-cb539e1a-439b-49c9-976f-026b4e0cce2c tempest-VolumesTestJSON-672841738 tempest-VolumesTestJSON-672841738-project] 10.222.0.58 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.088670 Jul 21 20:16:27.493688 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 532/1041] 10.222.0.58 () {58 vars in 1148 bytes} [Thu Jul 21 20:16:27 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:16:27.506004 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-4ce6c53f-f991-4e99-9709-d373474b7d44 tempest-VolumesTestJSON-672841738 tempest-VolumesTestJSON-672841738-project] Calling method '.version_select at 0x7f351cb2a940>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:16:27.588259 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-4ce6c53f-f991-4e99-9709-d373474b7d44 tempest-VolumesTestJSON-672841738 tempest-VolumesTestJSON-672841738-project] 10.222.0.58 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.086185 Jul 21 20:16:27.588824 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 510/1042] 10.222.0.58 () {58 vars in 1133 bytes} [Thu Jul 21 20:16:27 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:16:27.601000 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-de9ed3af-6328-40bd-a835-e5bd63c32882 tempest-VolumesTestJSON-672841738 tempest-VolumesTestJSON-672841738-project] Calling method '.version_select at 0x7f351cbbc430>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:16:27.688211 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-de9ed3af-6328-40bd-a835-e5bd63c32882 tempest-VolumesTestJSON-672841738 tempest-VolumesTestJSON-672841738-project] 10.222.0.58 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.091934 Jul 21 20:16:27.689181 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 533/1043] 10.222.0.58 () {58 vars in 1166 bytes} [Thu Jul 21 20:16:27 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:16:27.701362 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-e8c116a4-187a-4374-abeb-6753ad8fe85e tempest-VolumesTestJSON-672841738 tempest-VolumesTestJSON-672841738-project] Calling method '.version_select at 0x7f351cae6b80>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:16:27.787442 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-e8c116a4-187a-4374-abeb-6753ad8fe85e tempest-VolumesTestJSON-672841738 tempest-VolumesTestJSON-672841738-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.087108 Jul 21 20:16:27.787442 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 511/1044] 10.222.0.58 () {58 vars in 1169 bytes} [Thu Jul 21 20:16:27 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 20:16:27.796883 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-47c522ba-1f3a-451e-b3ab-077ad45345e0 tempest-VolumesTestJSON-672841738 tempest-VolumesTestJSON-672841738-project] Calling method '.version_select at 0x7f351cc0c700>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:16:27.878463 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-47c522ba-1f3a-451e-b3ab-077ad45345e0 tempest-VolumesTestJSON-672841738 tempest-VolumesTestJSON-672841738-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.085274 Jul 21 20:16:27.879044 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 534/1045] 10.222.0.58 () {58 vars in 1154 bytes} [Thu Jul 21 20:16:27 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:16:27.890254 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-c386e569-6022-4f9a-a252-422e4893c27e tempest-VolumesTestJSON-672841738 tempest-VolumesTestJSON-672841738-project] Calling method '.version_select at 0x7f351cae6940>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:16:27.981714 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-c386e569-6022-4f9a-a252-422e4893c27e tempest-VolumesTestJSON-672841738 tempest-VolumesTestJSON-672841738-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.095321 Jul 21 20:16:27.982304 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 512/1046] 10.222.0.58 () {58 vars in 1187 bytes} [Thu Jul 21 20:16:27 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:16:27.993691 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-f8352555-dd3c-4511-91eb-a4889495865f tempest-VolumesTestJSON-672841738 tempest-VolumesTestJSON-672841738-project] Calling method '.version_select at 0x7f351cdfc310>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:16:28.227796 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-f8352555-dd3c-4511-91eb-a4889495865f tempest-VolumesTestJSON-672841738 tempest-VolumesTestJSON-672841738-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.237896 Jul 21 20:16:28.236640 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 535/1047] 10.222.0.58 () {58 vars in 1154 bytes} [Thu Jul 21 20:16:27 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:16:28.242557 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-2f875a25-5377-48da-ac7f-6c1f6befa4da tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:16:28.243582 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-2f875a25-5377-48da-ac7f-6c1f6befa4da tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] [instance: 1daf616f-ebb1-4ffc-879b-abf65afca9bf] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:16:28.251104 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-2f875a25-5377-48da-ac7f-6c1f6befa4da tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:28.251659 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-2f875a25-5377-48da-ac7f-6c1f6befa4da tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:28.252513 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-2f875a25-5377-48da-ac7f-6c1f6befa4da tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:28.253025 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-2f875a25-5377-48da-ac7f-6c1f6befa4da tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:28.504816 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-2f875a25-5377-48da-ac7f-6c1f6befa4da tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6329f88fae384f20ad2f6aa66dc9864f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a0044f6e28474da9f3789f27654523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:16:28.519125 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-2f875a25-5377-48da-ac7f-6c1f6befa4da tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] 10.222.0.58 "GET /compute/v2.1/servers/1daf616f-ebb1-4ffc-879b-abf65afca9bf" status: 200 len: 1314 microversion: 2.1 time: 0.281251 Jul 21 20:16:28.530481 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 513/1048] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:16:28 2022] GET /compute/v2.1/servers/1daf616f-ebb1-4ffc-879b-abf65afca9bf => generated 1314 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:16:29.370235 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [req-b0eb9f45-2ab2-4907-b383-e8c8353e2d83 req-46059f9f-5a65-407b-91cd-d9b829deddd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1daf616f-ebb1-4ffc-879b-abf65afca9bf", "tag": "8c02e110-2b4b-47df-8b3c-8a259e2a63ac"}]} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:16:29.378988 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-b0eb9f45-2ab2-4907-b383-e8c8353e2d83 req-46059f9f-5a65-407b-91cd-d9b829deddd2 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:29.379455 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-b0eb9f45-2ab2-4907-b383-e8c8353e2d83 req-46059f9f-5a65-407b-91cd-d9b829deddd2 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:29.391407 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.compute.server_external_events [req-b0eb9f45-2ab2-4907-b383-e8c8353e2d83 req-46059f9f-5a65-407b-91cd-d9b829deddd2 service nova] Creating event network-changed:8c02e110-2b4b-47df-8b3c-8a259e2a63ac for instance 1daf616f-ebb1-4ffc-879b-abf65afca9bf on hv-cinder-85054 Jul 21 20:16:29.397259 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [req-b0eb9f45-2ab2-4907-b383-e8c8353e2d83 req-46059f9f-5a65-407b-91cd-d9b829deddd2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031618 Jul 21 20:16:29.397848 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 536/1049] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 20:16:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:16:29.539673 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-e4c87b3e-160f-47ce-af8b-6d140e2ed501 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:16:29.540281 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-e4c87b3e-160f-47ce-af8b-6d140e2ed501 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] [instance: 1daf616f-ebb1-4ffc-879b-abf65afca9bf] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:16:29.548194 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-e4c87b3e-160f-47ce-af8b-6d140e2ed501 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:29.548633 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-e4c87b3e-160f-47ce-af8b-6d140e2ed501 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:29.549395 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-e4c87b3e-160f-47ce-af8b-6d140e2ed501 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:29.549820 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-e4c87b3e-160f-47ce-af8b-6d140e2ed501 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:29.776522 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-e4c87b3e-160f-47ce-af8b-6d140e2ed501 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6329f88fae384f20ad2f6aa66dc9864f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a0044f6e28474da9f3789f27654523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:16:29.784394 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-e4c87b3e-160f-47ce-af8b-6d140e2ed501 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] 10.222.0.58 "GET /compute/v2.1/servers/1daf616f-ebb1-4ffc-879b-abf65afca9bf" status: 200 len: 1314 microversion: 2.1 time: 0.249638 Jul 21 20:16:29.784901 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 514/1050] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:16:29 2022] GET /compute/v2.1/servers/1daf616f-ebb1-4ffc-879b-abf65afca9bf => generated 1314 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:16:30.801034 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-d2aa4e6d-56c4-4cf1-8b18-ac9771747719 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:16:30.801737 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-d2aa4e6d-56c4-4cf1-8b18-ac9771747719 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] [instance: 1daf616f-ebb1-4ffc-879b-abf65afca9bf] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:16:30.804363 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:16:30.809309 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d2aa4e6d-56c4-4cf1-8b18-ac9771747719 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:30.809762 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d2aa4e6d-56c4-4cf1-8b18-ac9771747719 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:30.810532 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d2aa4e6d-56c4-4cf1-8b18-ac9771747719 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:30.810970 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d2aa4e6d-56c4-4cf1-8b18-ac9771747719 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:30.953214 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-d2aa4e6d-56c4-4cf1-8b18-ac9771747719 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6329f88fae384f20ad2f6aa66dc9864f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a0044f6e28474da9f3789f27654523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:16:30.961237 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-d2aa4e6d-56c4-4cf1-8b18-ac9771747719 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] 10.222.0.58 "GET /compute/v2.1/servers/1daf616f-ebb1-4ffc-879b-abf65afca9bf" status: 200 len: 1314 microversion: 2.1 time: 0.164678 Jul 21 20:16:30.961813 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 537/1051] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:16:30 2022] GET /compute/v2.1/servers/1daf616f-ebb1-4ffc-879b-abf65afca9bf => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:16:31.978295 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-5878af4e-7973-46c7-a5ca-a4a501383eb7 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:16:31.978986 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-5878af4e-7973-46c7-a5ca-a4a501383eb7 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] [instance: 1daf616f-ebb1-4ffc-879b-abf65afca9bf] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:16:31.985307 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-5878af4e-7973-46c7-a5ca-a4a501383eb7 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:31.986208 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-5878af4e-7973-46c7-a5ca-a4a501383eb7 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:31.986849 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-5878af4e-7973-46c7-a5ca-a4a501383eb7 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:31.987318 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-5878af4e-7973-46c7-a5ca-a4a501383eb7 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:32.123989 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-5878af4e-7973-46c7-a5ca-a4a501383eb7 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6329f88fae384f20ad2f6aa66dc9864f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a0044f6e28474da9f3789f27654523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:16:32.134641 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-5878af4e-7973-46c7-a5ca-a4a501383eb7 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] 10.222.0.58 "GET /compute/v2.1/servers/1daf616f-ebb1-4ffc-879b-abf65afca9bf" status: 200 len: 1314 microversion: 2.1 time: 0.160344 Jul 21 20:16:32.143005 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 515/1052] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:16:31 2022] GET /compute/v2.1/servers/1daf616f-ebb1-4ffc-879b-abf65afca9bf => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:16:33.158071 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-71f2682a-47d7-4c54-bb1e-e5fe2d08c62a tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:16:33.158817 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-71f2682a-47d7-4c54-bb1e-e5fe2d08c62a tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] [instance: 1daf616f-ebb1-4ffc-879b-abf65afca9bf] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:16:33.165919 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-71f2682a-47d7-4c54-bb1e-e5fe2d08c62a tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:33.166440 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-71f2682a-47d7-4c54-bb1e-e5fe2d08c62a tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:33.167335 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-71f2682a-47d7-4c54-bb1e-e5fe2d08c62a tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:33.167841 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-71f2682a-47d7-4c54-bb1e-e5fe2d08c62a tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:33.326265 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-71f2682a-47d7-4c54-bb1e-e5fe2d08c62a tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6329f88fae384f20ad2f6aa66dc9864f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a0044f6e28474da9f3789f27654523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:16:33.335261 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-71f2682a-47d7-4c54-bb1e-e5fe2d08c62a tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] 10.222.0.58 "GET /compute/v2.1/servers/1daf616f-ebb1-4ffc-879b-abf65afca9bf" status: 200 len: 1314 microversion: 2.1 time: 0.181587 Jul 21 20:16:33.335831 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 538/1053] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:16:33 2022] GET /compute/v2.1/servers/1daf616f-ebb1-4ffc-879b-abf65afca9bf => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:16:34.352762 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-c6a484fd-7340-4bce-b6ba-a8498d9db93e tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:16:34.353385 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-c6a484fd-7340-4bce-b6ba-a8498d9db93e tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] [instance: 1daf616f-ebb1-4ffc-879b-abf65afca9bf] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:16:34.356827 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG dbcounter [-] [118344] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=118344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:16:34.360347 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-c6a484fd-7340-4bce-b6ba-a8498d9db93e tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:34.360802 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-c6a484fd-7340-4bce-b6ba-a8498d9db93e tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:34.361591 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-c6a484fd-7340-4bce-b6ba-a8498d9db93e tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:34.362031 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-c6a484fd-7340-4bce-b6ba-a8498d9db93e tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:34.534502 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-c6a484fd-7340-4bce-b6ba-a8498d9db93e tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6329f88fae384f20ad2f6aa66dc9864f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a0044f6e28474da9f3789f27654523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:16:34.544899 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-c6a484fd-7340-4bce-b6ba-a8498d9db93e tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] 10.222.0.58 "GET /compute/v2.1/servers/1daf616f-ebb1-4ffc-879b-abf65afca9bf" status: 200 len: 1314 microversion: 2.1 time: 0.196010 Jul 21 20:16:34.545494 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 516/1054] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:16:34 2022] GET /compute/v2.1/servers/1daf616f-ebb1-4ffc-879b-abf65afca9bf => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:16:35.561834 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-5cf333c1-2f85-408c-b81d-6f47aa6cce99 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:16:35.562444 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-5cf333c1-2f85-408c-b81d-6f47aa6cce99 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] [instance: 1daf616f-ebb1-4ffc-879b-abf65afca9bf] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:16:35.564731 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell0:SELECT=2 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:16:35.565395 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell0:SELECT=6 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:16:35.570711 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5cf333c1-2f85-408c-b81d-6f47aa6cce99 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:35.571193 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5cf333c1-2f85-408c-b81d-6f47aa6cce99 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:35.571961 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5cf333c1-2f85-408c-b81d-6f47aa6cce99 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:35.572398 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5cf333c1-2f85-408c-b81d-6f47aa6cce99 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:35.718688 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-5cf333c1-2f85-408c-b81d-6f47aa6cce99 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6329f88fae384f20ad2f6aa66dc9864f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a0044f6e28474da9f3789f27654523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:16:35.727779 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-5cf333c1-2f85-408c-b81d-6f47aa6cce99 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] 10.222.0.58 "GET /compute/v2.1/servers/1daf616f-ebb1-4ffc-879b-abf65afca9bf" status: 200 len: 1314 microversion: 2.1 time: 0.169982 Jul 21 20:16:35.728753 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 539/1055] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:16:35 2022] GET /compute/v2.1/servers/1daf616f-ebb1-4ffc-879b-abf65afca9bf => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:16:36.403369 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG dbcounter [-] [118344] Writing DB stats nova_cell0:SELECT=2 {{(pid=118344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:16:36.638181 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [req-6d229471-f3c7-4973-80a8-500fb47880da req-428f8913-8064-489a-b7cf-d0906ec4548b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1daf616f-ebb1-4ffc-879b-abf65afca9bf", "name": "network-vif-plugged", "status": "completed", "tag": "8c02e110-2b4b-47df-8b3c-8a259e2a63ac"}]} {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:16:36.648049 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [req-6d229471-f3c7-4973-80a8-500fb47880da req-428f8913-8064-489a-b7cf-d0906ec4548b service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:36.648470 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [req-6d229471-f3c7-4973-80a8-500fb47880da req-428f8913-8064-489a-b7cf-d0906ec4548b service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:36.662277 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.compute.server_external_events [req-6d229471-f3c7-4973-80a8-500fb47880da req-428f8913-8064-489a-b7cf-d0906ec4548b service nova] Creating event network-vif-plugged:8c02e110-2b4b-47df-8b3c-8a259e2a63ac for instance 1daf616f-ebb1-4ffc-879b-abf65afca9bf on hv-cinder-85054 Jul 21 20:16:36.668265 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [req-6d229471-f3c7-4973-80a8-500fb47880da req-428f8913-8064-489a-b7cf-d0906ec4548b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.273656 Jul 21 20:16:36.673310 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 517/1056] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 20:16:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:16:36.745172 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-c147adbf-45f3-459f-8557-34533aa3e5ff tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:16:36.745779 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-c147adbf-45f3-459f-8557-34533aa3e5ff tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] [instance: 1daf616f-ebb1-4ffc-879b-abf65afca9bf] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:16:36.752294 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c147adbf-45f3-459f-8557-34533aa3e5ff tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:36.752743 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c147adbf-45f3-459f-8557-34533aa3e5ff tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:36.756101 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c147adbf-45f3-459f-8557-34533aa3e5ff tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:36.756101 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c147adbf-45f3-459f-8557-34533aa3e5ff tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:36.893697 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-c147adbf-45f3-459f-8557-34533aa3e5ff tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6329f88fae384f20ad2f6aa66dc9864f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a0044f6e28474da9f3789f27654523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:16:36.901815 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-c147adbf-45f3-459f-8557-34533aa3e5ff tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] 10.222.0.58 "GET /compute/v2.1/servers/1daf616f-ebb1-4ffc-879b-abf65afca9bf" status: 200 len: 1314 microversion: 2.1 time: 0.160969 Jul 21 20:16:36.902838 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 540/1057] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:16:36 2022] GET /compute/v2.1/servers/1daf616f-ebb1-4ffc-879b-abf65afca9bf => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:16:37.922475 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-2bc60bb8-82e1-45b4-b69e-d8c416e2b1a7 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:16:37.923384 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-2bc60bb8-82e1-45b4-b69e-d8c416e2b1a7 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] [instance: 1daf616f-ebb1-4ffc-879b-abf65afca9bf] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:16:37.931256 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-2bc60bb8-82e1-45b4-b69e-d8c416e2b1a7 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:37.931924 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-2bc60bb8-82e1-45b4-b69e-d8c416e2b1a7 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:37.932865 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-2bc60bb8-82e1-45b4-b69e-d8c416e2b1a7 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:37.933702 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-2bc60bb8-82e1-45b4-b69e-d8c416e2b1a7 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:38.090348 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-2bc60bb8-82e1-45b4-b69e-d8c416e2b1a7 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6329f88fae384f20ad2f6aa66dc9864f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a0044f6e28474da9f3789f27654523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:16:38.098546 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-2bc60bb8-82e1-45b4-b69e-d8c416e2b1a7 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] 10.222.0.58 "GET /compute/v2.1/servers/1daf616f-ebb1-4ffc-879b-abf65afca9bf" status: 200 len: 1314 microversion: 2.1 time: 0.182206 Jul 21 20:16:38.099745 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 518/1058] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:16:37 2022] GET /compute/v2.1/servers/1daf616f-ebb1-4ffc-879b-abf65afca9bf => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:16:39.116714 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-d09c4530-6a8d-4cb1-82f4-495ba6291db9 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:16:39.117322 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-d09c4530-6a8d-4cb1-82f4-495ba6291db9 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] [instance: 1daf616f-ebb1-4ffc-879b-abf65afca9bf] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:16:39.123865 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d09c4530-6a8d-4cb1-82f4-495ba6291db9 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:39.124532 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d09c4530-6a8d-4cb1-82f4-495ba6291db9 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:39.125195 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d09c4530-6a8d-4cb1-82f4-495ba6291db9 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:39.125626 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d09c4530-6a8d-4cb1-82f4-495ba6291db9 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:39.145664 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:16:39.265553 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-d09c4530-6a8d-4cb1-82f4-495ba6291db9 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6329f88fae384f20ad2f6aa66dc9864f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a0044f6e28474da9f3789f27654523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:16:39.272895 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-d09c4530-6a8d-4cb1-82f4-495ba6291db9 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] 10.222.0.58 "GET /compute/v2.1/servers/1daf616f-ebb1-4ffc-879b-abf65afca9bf" status: 200 len: 1497 microversion: 2.1 time: 0.160815 Jul 21 20:16:39.273456 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 541/1059] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:16:39 2022] GET /compute/v2.1/servers/1daf616f-ebb1-4ffc-879b-abf65afca9bf => generated 1497 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:16:40.206907 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-0e784a89-bba7-49ec-aa43-b5eec428cdf7 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:16:40.207557 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-0e784a89-bba7-49ec-aa43-b5eec428cdf7 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] [instance: 1daf616f-ebb1-4ffc-879b-abf65afca9bf] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:16:40.215166 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-0e784a89-bba7-49ec-aa43-b5eec428cdf7 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:40.215707 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-0e784a89-bba7-49ec-aa43-b5eec428cdf7 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:40.216562 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-0e784a89-bba7-49ec-aa43-b5eec428cdf7 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:40.217829 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-0e784a89-bba7-49ec-aa43-b5eec428cdf7 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:40.244734 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-0e784a89-bba7-49ec-aa43-b5eec428cdf7 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] [instance: 1daf616f-ebb1-4ffc-879b-abf65afca9bf] Going to try to terminate instance {{(pid=118344) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 20:16:40.586973 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-0e784a89-bba7-49ec-aa43-b5eec428cdf7 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] 10.222.0.58 "DELETE /compute/v2.1/servers/1daf616f-ebb1-4ffc-879b-abf65afca9bf" status: 204 len: 0 microversion: 2.1 time: 0.382799 Jul 21 20:16:40.587607 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 519/1060] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Jul 21 20:16:40 2022] DELETE /compute/v2.1/servers/1daf616f-ebb1-4ffc-879b-abf65afca9bf => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 20:16:40.602123 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-b43e550b-f12b-4fd7-9974-6a078494f13e tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:16:40.602746 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-b43e550b-f12b-4fd7-9974-6a078494f13e tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] [instance: 1daf616f-ebb1-4ffc-879b-abf65afca9bf] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:16:40.610417 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b43e550b-f12b-4fd7-9974-6a078494f13e tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:40.611271 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b43e550b-f12b-4fd7-9974-6a078494f13e tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:40.612362 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b43e550b-f12b-4fd7-9974-6a078494f13e tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:40.612798 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b43e550b-f12b-4fd7-9974-6a078494f13e tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:40.758285 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-b43e550b-f12b-4fd7-9974-6a078494f13e tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6329f88fae384f20ad2f6aa66dc9864f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a0044f6e28474da9f3789f27654523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:16:40.765663 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-b43e550b-f12b-4fd7-9974-6a078494f13e tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] 10.222.0.58 "GET /compute/v2.1/servers/1daf616f-ebb1-4ffc-879b-abf65afca9bf" status: 200 len: 1503 microversion: 2.1 time: 0.168682 Jul 21 20:16:40.766224 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 542/1061] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:16:40 2022] GET /compute/v2.1/servers/1daf616f-ebb1-4ffc-879b-abf65afca9bf => generated 1503 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:16:41.784479 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-d46d531f-3b8f-475a-a289-13bd16a31463 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:16:41.785170 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-d46d531f-3b8f-475a-a289-13bd16a31463 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] [instance: 1daf616f-ebb1-4ffc-879b-abf65afca9bf] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:16:41.792052 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-d46d531f-3b8f-475a-a289-13bd16a31463 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:41.792689 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-d46d531f-3b8f-475a-a289-13bd16a31463 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:41.793946 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-d46d531f-3b8f-475a-a289-13bd16a31463 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:41.794741 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-d46d531f-3b8f-475a-a289-13bd16a31463 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:41.938731 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-d46d531f-3b8f-475a-a289-13bd16a31463 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6329f88fae384f20ad2f6aa66dc9864f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a0044f6e28474da9f3789f27654523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:16:41.945957 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-d46d531f-3b8f-475a-a289-13bd16a31463 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] 10.222.0.58 "GET /compute/v2.1/servers/1daf616f-ebb1-4ffc-879b-abf65afca9bf" status: 200 len: 1503 microversion: 2.1 time: 0.165645 Jul 21 20:16:41.946521 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 520/1062] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:16:41 2022] GET /compute/v2.1/servers/1daf616f-ebb1-4ffc-879b-abf65afca9bf => generated 1503 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:16:42.964514 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-ad1cbf1a-b30a-4637-908c-cbdba83aba9a tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:16:42.965303 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-ad1cbf1a-b30a-4637-908c-cbdba83aba9a tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] [instance: 1daf616f-ebb1-4ffc-879b-abf65afca9bf] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:16:42.975578 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ad1cbf1a-b30a-4637-908c-cbdba83aba9a tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:42.976297 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ad1cbf1a-b30a-4637-908c-cbdba83aba9a tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:42.977433 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ad1cbf1a-b30a-4637-908c-cbdba83aba9a tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:42.978198 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ad1cbf1a-b30a-4637-908c-cbdba83aba9a tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:43.030889 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [req-5f2ed93d-6405-4ab4-933f-ffa99ea90de4 req-b1e63d10-97df-421c-84ae-6b325854f434 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1daf616f-ebb1-4ffc-879b-abf65afca9bf", "name": "network-vif-deleted", "tag": "8c02e110-2b4b-47df-8b3c-8a259e2a63ac"}]} {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:16:43.040579 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [req-5f2ed93d-6405-4ab4-933f-ffa99ea90de4 req-b1e63d10-97df-421c-84ae-6b325854f434 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:43.041276 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [req-5f2ed93d-6405-4ab4-933f-ffa99ea90de4 req-b1e63d10-97df-421c-84ae-6b325854f434 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:43.064319 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.compute.server_external_events [req-5f2ed93d-6405-4ab4-933f-ffa99ea90de4 req-b1e63d10-97df-421c-84ae-6b325854f434 service nova] Creating event network-vif-deleted:8c02e110-2b4b-47df-8b3c-8a259e2a63ac for instance 1daf616f-ebb1-4ffc-879b-abf65afca9bf on hv-cinder-85054 Jul 21 20:16:43.069532 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [req-5f2ed93d-6405-4ab4-933f-ffa99ea90de4 req-b1e63d10-97df-421c-84ae-6b325854f434 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042564 Jul 21 20:16:43.070375 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 521/1063] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 20:16:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 20:16:43.080981 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-ad1cbf1a-b30a-4637-908c-cbdba83aba9a tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6329f88fae384f20ad2f6aa66dc9864f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a0044f6e28474da9f3789f27654523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:16:43.088583 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-ad1cbf1a-b30a-4637-908c-cbdba83aba9a tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] 10.222.0.58 "GET /compute/v2.1/servers/1daf616f-ebb1-4ffc-879b-abf65afca9bf" status: 200 len: 1461 microversion: 2.1 time: 0.129165 Jul 21 20:16:43.090179 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 543/1064] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:16:42 2022] GET /compute/v2.1/servers/1daf616f-ebb1-4ffc-879b-abf65afca9bf => generated 1461 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:16:44.107773 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-3cc22f95-3964-496c-b376-f7db461febd4 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:16:44.109146 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-3cc22f95-3964-496c-b376-f7db461febd4 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] [instance: 1daf616f-ebb1-4ffc-879b-abf65afca9bf] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:16:44.116878 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-3cc22f95-3964-496c-b376-f7db461febd4 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:44.117664 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-3cc22f95-3964-496c-b376-f7db461febd4 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:44.118444 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-3cc22f95-3964-496c-b376-f7db461febd4 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:44.119124 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-3cc22f95-3964-496c-b376-f7db461febd4 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:44.136207 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG dbcounter [-] [118344] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:16:44.164025 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-3cc22f95-3964-496c-b376-f7db461febd4 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:44.164472 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-3cc22f95-3964-496c-b376-f7db461febd4 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:44.164916 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.objects.instance [None req-3cc22f95-3964-496c-b376-f7db461febd4 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lazy-loading 'fault' on Instance uuid 1daf616f-ebb1-4ffc-879b-abf65afca9bf {{(pid=118344) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 20:16:44.210140 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-3cc22f95-3964-496c-b376-f7db461febd4 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6329f88fae384f20ad2f6aa66dc9864f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a0044f6e28474da9f3789f27654523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:16:44.216837 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-3cc22f95-3964-496c-b376-f7db461febd4 tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] 10.222.0.58 "GET /compute/v2.1/servers/1daf616f-ebb1-4ffc-879b-abf65afca9bf" status: 200 len: 1304 microversion: 2.1 time: 0.113224 Jul 21 20:16:44.220905 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 522/1065] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:16:44 2022] GET /compute/v2.1/servers/1daf616f-ebb1-4ffc-879b-abf65afca9bf => generated 1304 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:16:45.233815 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-7c844660-d22c-4cea-8f3c-e5586c11437e tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:16:45.234427 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-7c844660-d22c-4cea-8f3c-e5586c11437e tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] [instance: 1daf616f-ebb1-4ffc-879b-abf65afca9bf] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:16:45.240810 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-7c844660-d22c-4cea-8f3c-e5586c11437e tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:45.241251 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-7c844660-d22c-4cea-8f3c-e5586c11437e tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:45.242005 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-7c844660-d22c-4cea-8f3c-e5586c11437e tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:16:45.242436 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-7c844660-d22c-4cea-8f3c-e5586c11437e tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:16:45.258019 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.wsgi [None req-7c844660-d22c-4cea-8f3c-e5586c11437e tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] HTTP exception thrown: Instance 1daf616f-ebb1-4ffc-879b-abf65afca9bf could not be found. Jul 21 20:16:45.259704 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-7c844660-d22c-4cea-8f3c-e5586c11437e tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Request method failure captured: Jul 21 20:16:45.259704 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: request: GET /compute/v2.1/servers/1daf616f-ebb1-4ffc-879b-abf65afca9bf HTTP/1.1 Jul 21 20:16:45.259704 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Accept: application/json Jul 21 20:16:45.259704 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Accept-Encoding: identity Jul 21 20:16:45.259704 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Connection: close Jul 21 20:16:45.259704 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Content-Length: 0 Jul 21 20:16:45.259704 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Content-Type: application/json Jul 21 20:16:45.259704 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Host: 10.222.0.58 Jul 21 20:16:45.259704 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Openstack-System-Scope: None Jul 21 20:16:45.259704 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: User-Agent: python-urllib3/1.26.9 Jul 21 20:16:45.259704 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Auth-Token: gAAAAABi2bQD5vDsAzTcLKy-zAl7CcnO2XucZG2v796Wim_bUl9rgCL8a6F2rjSku4TB3o2zu0WhFhmDtSvoXcxdreEo00rc8rK5MAh_xqIIe3JRxcNG1sOXPi2YuaS8tKctrsjPRD4ZmPjNsohBt1X8T_YTc2S3CHFI60HTiZf17HGK3923Xho Jul 21 20:16:45.259704 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Domain-Id: None Jul 21 20:16:45.259704 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Domain-Name: None Jul 21 20:16:45.259704 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Identity-Status: Confirmed Jul 21 20:16:45.259704 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Is-Admin-Project: True Jul 21 20:16:45.259704 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Id: default Jul 21 20:16:45.259704 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Name: Default Jul 21 20:16:45.259704 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Id: d7a0044f6e28474da9f3789f27654523 Jul 21 20:16:45.259704 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Name: tempest-VolumesActionsTest-286079502 Jul 21 20:16:45.259704 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Role: reader,member Jul 21 20:16:45.259704 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Roles: reader,member Jul 21 20:16:45.261371 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d7a0044f6e28474da9f3789f27654523"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d7a0044f6e28474da9f3789f27654523"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d7a0044f6e28474da9f3789f27654523"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d7a0044f6e28474da9f3789f27654523"}]}] Jul 21 20:16:45.261371 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Tenant: tempest-VolumesActionsTest-286079502 Jul 21 20:16:45.261371 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Tenant-Id: d7a0044f6e28474da9f3789f27654523 Jul 21 20:16:45.261371 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Tenant-Name: tempest-VolumesActionsTest-286079502 Jul 21 20:16:45.261371 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User: tempest-VolumesActionsTest-286079502-project Jul 21 20:16:45.261371 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Id: default Jul 21 20:16:45.261371 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Name: Default Jul 21 20:16:45.261371 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Id: 6329f88fae384f20ad2f6aa66dc9864f Jul 21 20:16:45.261371 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Name: tempest-VolumesActionsTest-286079502-project Jul 21 20:16:45.261371 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: method: > Jul 21 20:16:45.261371 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: exception: Instance 1daf616f-ebb1-4ffc-879b-abf65afca9bf could not be found. Jul 21 20:16:45.261371 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: action_args: {'id': '1daf616f-ebb1-4ffc-879b-abf65afca9bf'} Jul 21 20:16:45.262208 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 20:16:45.262208 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:16:45.262208 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 20:16:45.262208 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 20:16:45.262208 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 20:16:45.262208 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 20:16:45.262208 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 20:16:45.262208 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 20:16:45.262208 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 20:16:45.262208 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 20:16:45.262208 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1daf616f-ebb1-4ffc-879b-abf65afca9bf could not be found. Jul 21 20:16:45.262208 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:16:45.262208 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:16:45.262208 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:16:45.262208 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:16:45.262208 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:16:45.262208 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:16:45.262208 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 20:16:45.262208 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 20:16:45.262208 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 20:16:45.263556 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 20:16:45.263556 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 20:16:45.263556 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 20:16:45.263556 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 20:16:45.263556 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 20:16:45.263556 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 20:16:45.263556 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 20:16:45.263556 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1daf616f-ebb1-4ffc-879b-abf65afca9bf could not be found. Jul 21 20:16:45.263556 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:16:45.263556 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:16:45.263556 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:16:45.263556 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:16:45.263556 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:16:45.263556 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:16:45.263556 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 20:16:45.263556 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 20:16:45.263556 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1daf616f-ebb1-4ffc-879b-abf65afca9bf could not be found. Jul 21 20:16:45.263556 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:16:45.264993 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-7c844660-d22c-4cea-8f3c-e5586c11437e tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] Returning 404 to user: Instance 1daf616f-ebb1-4ffc-879b-abf65afca9bf could not be found. {{(pid=118345) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 20:16:45.264993 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-7c844660-d22c-4cea-8f3c-e5586c11437e tempest-VolumesActionsTest-286079502 tempest-VolumesActionsTest-286079502-project] 10.222.0.58 "GET /compute/v2.1/servers/1daf616f-ebb1-4ffc-879b-abf65afca9bf" status: 404 len: 111 microversion: 2.1 time: 0.031098 Jul 21 20:16:45.264993 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 544/1066] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:16:45 2022] GET /compute/v2.1/servers/1daf616f-ebb1-4ffc-879b-abf65afca9bf => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 20:18:02.191091 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG dbcounter [-] [118344] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1 {{(pid=118344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:18:02.195821 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-c0e06c3d-8e61-4c4c-805b-e3610986703f tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Action: 'create', calling method: .version_select at 0x7f351cb29940>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-732270295", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLBfDapOP1xgogk8sZilg4z7rlegr5Dpj6hxfDlBqZFgdPt3bTXUDWc14avYsBjNRgnUwooAj/RHHwlKfxzTraLJGYmnzNleHlKHZjX/5XQKE2JhGEM+IS1Q8dgn5qCLow=="}} {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:18:02.210252 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.quota [None req-c0e06c3d-8e61-4c4c-805b-e3610986703f tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Getting quotas for project 3c262cd918784d6490dcd78eda61c551. Resources: {'key_pairs'} {{(pid=118344) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 20:18:02.214082 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.quota [None req-c0e06c3d-8e61-4c4c-805b-e3610986703f tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Getting quotas for user 216eb0b454534a878c30a23e9126ff9f and project 3c262cd918784d6490dcd78eda61c551. Resources: {'key_pairs'} {{(pid=118344) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 20:18:02.297961 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-c0e06c3d-8e61-4c4c-805b-e3610986703f tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.108928 Jul 21 20:18:02.298560 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 523/1067] 10.222.0.58 () {60 vars in 1158 bytes} [Thu Jul 21 20:18:02 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:18:02.351768 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_api:SELECT=15 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:18:02.352998 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell1:SELECT=16 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:18:02.357092 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-08711465-0be1-41a2-8691-84fe83660217 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1012627492", "imageRef": "bd33e8b1-784d-4dbc-a438-0e02cdb79a0f", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-732270295", "networks": [{"uuid": "b4aa7d7a-a55e-43e4-99db-f7d1bce8d060"}]}} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:18:02.410215 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.network.neutron [None req-08711465-0be1-41a2-8691-84fe83660217 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] validate_networks() for [('b4aa7d7a-a55e-43e4-99db-f7d1bce8d060', None, None, None, None, None)] {{(pid=118345) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 20:18:02.909668 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-08711465-0be1-41a2-8691-84fe83660217 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Flavor limits 0:0:0 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 20:18:02.910086 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-08711465-0be1-41a2-8691-84fe83660217 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Image limits 0:0:0 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 20:18:02.910550 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-08711465-0be1-41a2-8691-84fe83660217 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Flavor pref 0:0:0 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 20:18:02.914871 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-08711465-0be1-41a2-8691-84fe83660217 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Image pref 0:0:0 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 20:18:02.914871 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-08711465-0be1-41a2-8691-84fe83660217 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 20:18:02.920714 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-08711465-0be1-41a2-8691-84fe83660217 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:02.921238 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-08711465-0be1-41a2-8691-84fe83660217 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:02.922078 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-08711465-0be1-41a2-8691-84fe83660217 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:02.922503 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-08711465-0be1-41a2-8691-84fe83660217 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:02.939463 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.quota [None req-08711465-0be1-41a2-8691-84fe83660217 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Getting quotas for project 3c262cd918784d6490dcd78eda61c551. Resources: {'instances', 'cores', 'ram'} {{(pid=118345) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 20:18:02.943295 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.quota [None req-08711465-0be1-41a2-8691-84fe83660217 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Getting quotas for user 216eb0b454534a878c30a23e9126ff9f and project 3c262cd918784d6490dcd78eda61c551. Resources: {'instances', 'cores', 'ram'} {{(pid=118345) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 20:18:02.954539 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-08711465-0be1-41a2-8691-84fe83660217 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Going to run 1 instances... {{(pid=118345) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 20:18:02.956814 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-08711465-0be1-41a2-8691-84fe83660217 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] [instance: 25c00062-b8e5-4575-a993-bcace67b3682] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd33e8b1-784d-4dbc-a438-0e02cdb79a0f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118345) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 20:18:03.075158 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-08711465-0be1-41a2-8691-84fe83660217 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.724856 Jul 21 20:18:03.075990 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 545/1068] 10.222.0.58 () {60 vars in 1146 bytes} [Thu Jul 21 20:18:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 726 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 20:18:03.086020 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-36e1049c-7573-426e-acf8-621826ae9eae tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:18:03.087272 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-36e1049c-7573-426e-acf8-621826ae9eae tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] [instance: 25c00062-b8e5-4575-a993-bcace67b3682] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:18:03.145750 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-36e1049c-7573-426e-acf8-621826ae9eae tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216eb0b454534a878c30a23e9126ff9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c262cd918784d6490dcd78eda61c551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:18:03.159994 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-36e1049c-7573-426e-acf8-621826ae9eae tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] 10.222.0.58 "GET /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682" status: 200 len: 1258 microversion: 2.1 time: 0.078141 Jul 21 20:18:03.160666 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 524/1069] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:18:03 2022] GET /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682 => generated 1258 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:18:04.177701 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-005e9a0a-aa8a-4ba3-b34c-c3cb25002568 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:18:04.178304 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-005e9a0a-aa8a-4ba3-b34c-c3cb25002568 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] [instance: 25c00062-b8e5-4575-a993-bcace67b3682] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:18:04.184807 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-005e9a0a-aa8a-4ba3-b34c-c3cb25002568 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:04.185253 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-005e9a0a-aa8a-4ba3-b34c-c3cb25002568 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:04.191100 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-005e9a0a-aa8a-4ba3-b34c-c3cb25002568 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:04.191100 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-005e9a0a-aa8a-4ba3-b34c-c3cb25002568 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:04.252135 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-005e9a0a-aa8a-4ba3-b34c-c3cb25002568 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216eb0b454534a878c30a23e9126ff9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c262cd918784d6490dcd78eda61c551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:18:04.260461 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-005e9a0a-aa8a-4ba3-b34c-c3cb25002568 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] 10.222.0.58 "GET /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682" status: 200 len: 1262 microversion: 2.1 time: 0.087214 Jul 21 20:18:04.261030 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 546/1070] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:18:04 2022] GET /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682 => generated 1262 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:18:05.278247 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-37fa1169-65d1-4c65-8f2a-157cde37418e tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:18:05.284270 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-37fa1169-65d1-4c65-8f2a-157cde37418e tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] [instance: 25c00062-b8e5-4575-a993-bcace67b3682] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:18:05.287292 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-37fa1169-65d1-4c65-8f2a-157cde37418e tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:05.287751 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-37fa1169-65d1-4c65-8f2a-157cde37418e tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:05.288558 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-37fa1169-65d1-4c65-8f2a-157cde37418e tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:05.288992 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-37fa1169-65d1-4c65-8f2a-157cde37418e tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:05.352198 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-37fa1169-65d1-4c65-8f2a-157cde37418e tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216eb0b454534a878c30a23e9126ff9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c262cd918784d6490dcd78eda61c551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:18:05.360296 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-37fa1169-65d1-4c65-8f2a-157cde37418e tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] 10.222.0.58 "GET /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682" status: 200 len: 1310 microversion: 2.1 time: 0.086932 Jul 21 20:18:05.360963 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 525/1071] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:18:05 2022] GET /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682 => generated 1310 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:18:06.381068 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-f84ecaa2-6050-4299-95c7-8248f5db6ae1 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:18:06.381849 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-f84ecaa2-6050-4299-95c7-8248f5db6ae1 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] [instance: 25c00062-b8e5-4575-a993-bcace67b3682] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:18:06.395577 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f84ecaa2-6050-4299-95c7-8248f5db6ae1 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:06.396602 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f84ecaa2-6050-4299-95c7-8248f5db6ae1 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:06.398651 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f84ecaa2-6050-4299-95c7-8248f5db6ae1 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:06.403712 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f84ecaa2-6050-4299-95c7-8248f5db6ae1 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:06.594095 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-f84ecaa2-6050-4299-95c7-8248f5db6ae1 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216eb0b454534a878c30a23e9126ff9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c262cd918784d6490dcd78eda61c551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:18:06.601911 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-f84ecaa2-6050-4299-95c7-8248f5db6ae1 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] 10.222.0.58 "GET /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682" status: 200 len: 1358 microversion: 2.1 time: 0.227534 Jul 21 20:18:06.608124 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 547/1072] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:18:06 2022] GET /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682 => generated 1358 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:18:07.250536 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [req-ec1844dd-4d62-4861-bcdc-b00868a8578e req-1fbdb8c5-91e3-4fe4-987a-e7b430c1bd08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25c00062-b8e5-4575-a993-bcace67b3682", "tag": "eae9dff4-a338-4cab-b3de-c05350da7fab"}]} {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:18:07.286409 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [req-ec1844dd-4d62-4861-bcdc-b00868a8578e req-1fbdb8c5-91e3-4fe4-987a-e7b430c1bd08 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:07.287155 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [req-ec1844dd-4d62-4861-bcdc-b00868a8578e req-1fbdb8c5-91e3-4fe4-987a-e7b430c1bd08 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:07.304299 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.compute.server_external_events [req-ec1844dd-4d62-4861-bcdc-b00868a8578e req-1fbdb8c5-91e3-4fe4-987a-e7b430c1bd08 service nova] Creating event network-changed:eae9dff4-a338-4cab-b3de-c05350da7fab for instance 25c00062-b8e5-4575-a993-bcace67b3682 on hv-cinder-85054 Jul 21 20:18:07.310438 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [req-ec1844dd-4d62-4861-bcdc-b00868a8578e req-1fbdb8c5-91e3-4fe4-987a-e7b430c1bd08 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064520 Jul 21 20:18:07.311531 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 526/1073] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 20:18:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:18:07.536087 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-01b3ae80-5219-483e-8f7c-cb9305a6e623 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-226509741", "imageRef": "357a1479-6cbd-4882-8d3f-d945fa40e6df", "flavorRef": "452"}} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:18:07.599292 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.network.neutron [None req-01b3ae80-5219-483e-8f7c-cb9305a6e623 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] validate_networks() for None {{(pid=118345) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 20:18:07.622146 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-fdf29180-3650-4055-a4ac-a2cc2e182598 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:18:07.623943 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-fdf29180-3650-4055-a4ac-a2cc2e182598 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] [instance: 25c00062-b8e5-4575-a993-bcace67b3682] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:18:07.634290 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-fdf29180-3650-4055-a4ac-a2cc2e182598 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:07.635046 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-fdf29180-3650-4055-a4ac-a2cc2e182598 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:07.636005 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-fdf29180-3650-4055-a4ac-a2cc2e182598 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:07.636601 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-fdf29180-3650-4055-a4ac-a2cc2e182598 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:07.804672 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-fdf29180-3650-4055-a4ac-a2cc2e182598 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216eb0b454534a878c30a23e9126ff9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c262cd918784d6490dcd78eda61c551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:18:07.813476 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-fdf29180-3650-4055-a4ac-a2cc2e182598 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] 10.222.0.58 "GET /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682" status: 200 len: 1358 microversion: 2.1 time: 0.196600 Jul 21 20:18:07.819236 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 527/1074] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:18:07 2022] GET /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682 => generated 1358 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:18:07.825249 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-74b30935-0943-438f-8ab6-86e986cf5252 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:18:07.826127 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-74b30935-0943-438f-8ab6-86e986cf5252 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] [instance: 80714390-c8b6-4703-a02a-d41fafad3540] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:18:07.833665 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-74b30935-0943-438f-8ab6-86e986cf5252 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:07.834515 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-74b30935-0943-438f-8ab6-86e986cf5252 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:07.835775 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-74b30935-0943-438f-8ab6-86e986cf5252 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:07.837128 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-74b30935-0943-438f-8ab6-86e986cf5252 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:07.865826 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-74b30935-0943-438f-8ab6-86e986cf5252 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] [instance: 80714390-c8b6-4703-a02a-d41fafad3540] Going to try to terminate instance {{(pid=118344) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 20:18:08.177697 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-74b30935-0943-438f-8ab6-86e986cf5252 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] 10.222.0.58 "DELETE /compute/v2.1/servers/80714390-c8b6-4703-a02a-d41fafad3540" status: 204 len: 0 microversion: 2.1 time: 0.362257 Jul 21 20:18:08.178751 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 528/1075] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Jul 21 20:18:07 2022] DELETE /compute/v2.1/servers/80714390-c8b6-4703-a02a-d41fafad3540 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 20:18:08.193492 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-021ddaa6-9852-44fe-8d30-f7ec66dc02df tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:18:08.194199 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-021ddaa6-9852-44fe-8d30-f7ec66dc02df tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] [instance: 80714390-c8b6-4703-a02a-d41fafad3540] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:18:08.201606 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-021ddaa6-9852-44fe-8d30-f7ec66dc02df tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:08.202059 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-021ddaa6-9852-44fe-8d30-f7ec66dc02df tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:08.202838 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-021ddaa6-9852-44fe-8d30-f7ec66dc02df tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:08.203303 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-021ddaa6-9852-44fe-8d30-f7ec66dc02df tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:08.231431 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-01b3ae80-5219-483e-8f7c-cb9305a6e623 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Flavor limits 0:0:0 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 20:18:08.232125 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-01b3ae80-5219-483e-8f7c-cb9305a6e623 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Image limits 0:0:0 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 20:18:08.232799 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-01b3ae80-5219-483e-8f7c-cb9305a6e623 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Flavor pref 0:0:0 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 20:18:08.233780 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-01b3ae80-5219-483e-8f7c-cb9305a6e623 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Image pref 0:0:0 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 20:18:08.234417 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-01b3ae80-5219-483e-8f7c-cb9305a6e623 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 20:18:08.253647 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-01b3ae80-5219-483e-8f7c-cb9305a6e623 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:08.254205 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-01b3ae80-5219-483e-8f7c-cb9305a6e623 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:08.255093 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-01b3ae80-5219-483e-8f7c-cb9305a6e623 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:08.255589 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-01b3ae80-5219-483e-8f7c-cb9305a6e623 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:08.274662 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.quota [None req-01b3ae80-5219-483e-8f7c-cb9305a6e623 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Getting quotas for project 9872332c8270445f9feacb0d76982f12. Resources: {'instances', 'cores', 'ram'} {{(pid=118345) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 20:18:08.278642 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.quota [None req-01b3ae80-5219-483e-8f7c-cb9305a6e623 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Getting quotas for user f41baf9558b04546aaa5bf112e4c4fe5 and project 9872332c8270445f9feacb0d76982f12. Resources: {'instances', 'cores', 'ram'} {{(pid=118345) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 20:18:08.291208 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-01b3ae80-5219-483e-8f7c-cb9305a6e623 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Going to run 1 instances... {{(pid=118345) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 20:18:08.293705 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-01b3ae80-5219-483e-8f7c-cb9305a6e623 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] [instance: 6088dba0-f178-48c2-8fed-1e0c93d88aed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='357a1479-6cbd-4882-8d3f-d945fa40e6df',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118345) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 20:18:08.364455 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-021ddaa6-9852-44fe-8d30-f7ec66dc02df tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4460571d9294e38931274a55c6c5857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a259cf4b240fba9b065a43b2ed4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:18:08.372848 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-021ddaa6-9852-44fe-8d30-f7ec66dc02df tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] 10.222.0.58 "GET /compute/v2.1/servers/80714390-c8b6-4703-a02a-d41fafad3540" status: 200 len: 1578 microversion: 2.1 time: 0.188938 Jul 21 20:18:08.373541 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 529/1076] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:18:08 2022] GET /compute/v2.1/servers/80714390-c8b6-4703-a02a-d41fafad3540 => generated 1578 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:18:08.429771 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-01b3ae80-5219-483e-8f7c-cb9305a6e623 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.897878 Jul 21 20:18:08.436130 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 548/1077] 10.222.0.58 () {60 vars in 1146 bytes} [Thu Jul 21 20:18:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 905 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 20:18:08.440949 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-34d7ca9c-5293-4ac2-9123-91106e9ded9e tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:18:08.443145 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-34d7ca9c-5293-4ac2-9123-91106e9ded9e tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] [instance: 6088dba0-f178-48c2-8fed-1e0c93d88aed] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:18:08.525760 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-34d7ca9c-5293-4ac2-9123-91106e9ded9e tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f41baf9558b04546aaa5bf112e4c4fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9872332c8270445f9feacb0d76982f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:18:08.535315 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-34d7ca9c-5293-4ac2-9123-91106e9ded9e tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] 10.222.0.58 "GET /compute/v2.1/servers/6088dba0-f178-48c2-8fed-1e0c93d88aed" status: 200 len: 1214 microversion: 2.1 time: 0.097613 Jul 21 20:18:08.543688 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 530/1078] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:18:08 2022] GET /compute/v2.1/servers/6088dba0-f178-48c2-8fed-1e0c93d88aed => generated 1214 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:18:08.832102 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-f89bfe94-00d1-4165-b40b-2f971f936fe6 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:18:08.833606 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-f89bfe94-00d1-4165-b40b-2f971f936fe6 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] [instance: 25c00062-b8e5-4575-a993-bcace67b3682] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:18:08.844291 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f89bfe94-00d1-4165-b40b-2f971f936fe6 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:08.845000 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f89bfe94-00d1-4165-b40b-2f971f936fe6 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:08.846759 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f89bfe94-00d1-4165-b40b-2f971f936fe6 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:08.847514 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f89bfe94-00d1-4165-b40b-2f971f936fe6 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:09.014493 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-f89bfe94-00d1-4165-b40b-2f971f936fe6 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216eb0b454534a878c30a23e9126ff9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c262cd918784d6490dcd78eda61c551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:18:09.022911 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-f89bfe94-00d1-4165-b40b-2f971f936fe6 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] 10.222.0.58 "GET /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682" status: 200 len: 1358 microversion: 2.1 time: 0.196529 Jul 21 20:18:09.023530 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 549/1079] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:18:08 2022] GET /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682 => generated 1358 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:18:09.389870 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-3ed1c20f-3b67-45a9-8479-ddd91999a849 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:18:09.390568 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-3ed1c20f-3b67-45a9-8479-ddd91999a849 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] [instance: 80714390-c8b6-4703-a02a-d41fafad3540] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:18:09.397209 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-3ed1c20f-3b67-45a9-8479-ddd91999a849 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:09.397664 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-3ed1c20f-3b67-45a9-8479-ddd91999a849 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:09.398439 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-3ed1c20f-3b67-45a9-8479-ddd91999a849 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:09.399407 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-3ed1c20f-3b67-45a9-8479-ddd91999a849 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:09.553930 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-434a4cfc-e636-4c71-956e-12c9d9b7812d tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:18:09.554871 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-434a4cfc-e636-4c71-956e-12c9d9b7812d tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] [instance: 6088dba0-f178-48c2-8fed-1e0c93d88aed] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:18:09.561682 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-434a4cfc-e636-4c71-956e-12c9d9b7812d tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:09.562331 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-434a4cfc-e636-4c71-956e-12c9d9b7812d tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:09.562945 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-3ed1c20f-3b67-45a9-8479-ddd91999a849 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4460571d9294e38931274a55c6c5857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a259cf4b240fba9b065a43b2ed4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:18:09.563304 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-434a4cfc-e636-4c71-956e-12c9d9b7812d tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:09.563796 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-434a4cfc-e636-4c71-956e-12c9d9b7812d tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:09.571590 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-3ed1c20f-3b67-45a9-8479-ddd91999a849 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] 10.222.0.58 "GET /compute/v2.1/servers/80714390-c8b6-4703-a02a-d41fafad3540" status: 200 len: 1578 microversion: 2.1 time: 0.185560 Jul 21 20:18:09.572637 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 531/1080] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:18:09 2022] GET /compute/v2.1/servers/80714390-c8b6-4703-a02a-d41fafad3540 => generated 1578 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:18:09.634036 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-434a4cfc-e636-4c71-956e-12c9d9b7812d tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f41baf9558b04546aaa5bf112e4c4fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9872332c8270445f9feacb0d76982f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:18:09.642657 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-434a4cfc-e636-4c71-956e-12c9d9b7812d tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] 10.222.0.58 "GET /compute/v2.1/servers/6088dba0-f178-48c2-8fed-1e0c93d88aed" status: 200 len: 1218 microversion: 2.1 time: 0.092227 Jul 21 20:18:09.644028 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 550/1081] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:18:09 2022] GET /compute/v2.1/servers/6088dba0-f178-48c2-8fed-1e0c93d88aed => generated 1218 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:18:10.040948 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-19b22bc8-8452-4675-8fc6-0ff08abb6dc5 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:18:10.041939 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-19b22bc8-8452-4675-8fc6-0ff08abb6dc5 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] [instance: 25c00062-b8e5-4575-a993-bcace67b3682] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:18:10.053698 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-19b22bc8-8452-4675-8fc6-0ff08abb6dc5 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:10.054310 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-19b22bc8-8452-4675-8fc6-0ff08abb6dc5 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:10.055289 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-19b22bc8-8452-4675-8fc6-0ff08abb6dc5 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:10.055854 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-19b22bc8-8452-4675-8fc6-0ff08abb6dc5 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:10.212925 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-19b22bc8-8452-4675-8fc6-0ff08abb6dc5 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216eb0b454534a878c30a23e9126ff9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c262cd918784d6490dcd78eda61c551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:18:10.221428 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-19b22bc8-8452-4675-8fc6-0ff08abb6dc5 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] 10.222.0.58 "GET /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682" status: 200 len: 1358 microversion: 2.1 time: 0.184966 Jul 21 20:18:10.227886 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 532/1082] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:18:10 2022] GET /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682 => generated 1358 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:18:10.643102 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-f868a52a-35b2-4cb5-a9b3-8927664f107a tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:18:10.643102 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-f868a52a-35b2-4cb5-a9b3-8927664f107a tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] [instance: 80714390-c8b6-4703-a02a-d41fafad3540] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:18:10.643102 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f868a52a-35b2-4cb5-a9b3-8927664f107a tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:10.643102 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f868a52a-35b2-4cb5-a9b3-8927664f107a tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:10.643862 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f868a52a-35b2-4cb5-a9b3-8927664f107a tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:10.643862 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f868a52a-35b2-4cb5-a9b3-8927664f107a tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:10.661606 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-38636283-6417-4bd5-b304-ef11dca2c3b3 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:18:10.662215 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-38636283-6417-4bd5-b304-ef11dca2c3b3 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] [instance: 6088dba0-f178-48c2-8fed-1e0c93d88aed] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:18:10.678446 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-38636283-6417-4bd5-b304-ef11dca2c3b3 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:10.679003 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-38636283-6417-4bd5-b304-ef11dca2c3b3 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:10.680276 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-38636283-6417-4bd5-b304-ef11dca2c3b3 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:10.680761 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-38636283-6417-4bd5-b304-ef11dca2c3b3 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:10.750179 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-38636283-6417-4bd5-b304-ef11dca2c3b3 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f41baf9558b04546aaa5bf112e4c4fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9872332c8270445f9feacb0d76982f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:18:10.763066 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-38636283-6417-4bd5-b304-ef11dca2c3b3 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] 10.222.0.58 "GET /compute/v2.1/servers/6088dba0-f178-48c2-8fed-1e0c93d88aed" status: 200 len: 1218 microversion: 2.1 time: 0.105922 Jul 21 20:18:10.763766 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 533/1083] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:18:10 2022] GET /compute/v2.1/servers/6088dba0-f178-48c2-8fed-1e0c93d88aed => generated 1218 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:18:10.838709 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-f868a52a-35b2-4cb5-a9b3-8927664f107a tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4460571d9294e38931274a55c6c5857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a259cf4b240fba9b065a43b2ed4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:18:10.838709 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-f868a52a-35b2-4cb5-a9b3-8927664f107a tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] 10.222.0.58 "GET /compute/v2.1/servers/80714390-c8b6-4703-a02a-d41fafad3540" status: 200 len: 1578 microversion: 2.1 time: 0.239959 Jul 21 20:18:10.838709 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 551/1084] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:18:10 2022] GET /compute/v2.1/servers/80714390-c8b6-4703-a02a-d41fafad3540 => generated 1578 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:18:11.239247 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-cc65ada4-9fd3-4ce4-8994-3ab898774e81 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:18:11.239974 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-cc65ada4-9fd3-4ce4-8994-3ab898774e81 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] [instance: 25c00062-b8e5-4575-a993-bcace67b3682] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:18:11.246853 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-cc65ada4-9fd3-4ce4-8994-3ab898774e81 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:11.247411 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-cc65ada4-9fd3-4ce4-8994-3ab898774e81 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:11.248269 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-cc65ada4-9fd3-4ce4-8994-3ab898774e81 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:11.248793 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-cc65ada4-9fd3-4ce4-8994-3ab898774e81 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:11.395058 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-cc65ada4-9fd3-4ce4-8994-3ab898774e81 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216eb0b454534a878c30a23e9126ff9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c262cd918784d6490dcd78eda61c551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:18:11.396702 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-cc65ada4-9fd3-4ce4-8994-3ab898774e81 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] 10.222.0.58 "GET /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682" status: 200 len: 1358 microversion: 2.1 time: 0.161380 Jul 21 20:18:11.397685 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 534/1085] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:18:11 2022] GET /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:18:11.780563 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-b0484d7b-6944-4b0a-b12d-58153a878491 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:18:11.781183 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-b0484d7b-6944-4b0a-b12d-58153a878491 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] [instance: 6088dba0-f178-48c2-8fed-1e0c93d88aed] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:18:11.787971 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b0484d7b-6944-4b0a-b12d-58153a878491 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:11.788517 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b0484d7b-6944-4b0a-b12d-58153a878491 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:11.789299 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b0484d7b-6944-4b0a-b12d-58153a878491 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:11.789730 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b0484d7b-6944-4b0a-b12d-58153a878491 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:11.855734 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-2187b662-02bf-40eb-8caa-eca1a760835b tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:18:11.857002 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-2187b662-02bf-40eb-8caa-eca1a760835b tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] [instance: 80714390-c8b6-4703-a02a-d41fafad3540] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:18:11.865391 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-b0484d7b-6944-4b0a-b12d-58153a878491 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f41baf9558b04546aaa5bf112e4c4fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9872332c8270445f9feacb0d76982f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:18:11.871495 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-2187b662-02bf-40eb-8caa-eca1a760835b tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:11.872222 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-2187b662-02bf-40eb-8caa-eca1a760835b tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:11.873234 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-2187b662-02bf-40eb-8caa-eca1a760835b tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:11.873665 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-2187b662-02bf-40eb-8caa-eca1a760835b tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:11.875858 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-b0484d7b-6944-4b0a-b12d-58153a878491 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] 10.222.0.58 "GET /compute/v2.1/servers/6088dba0-f178-48c2-8fed-1e0c93d88aed" status: 200 len: 1218 microversion: 2.1 time: 0.099048 Jul 21 20:18:11.887471 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 552/1086] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:18:11 2022] GET /compute/v2.1/servers/6088dba0-f178-48c2-8fed-1e0c93d88aed => generated 1218 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:18:12.025666 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-2187b662-02bf-40eb-8caa-eca1a760835b tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4460571d9294e38931274a55c6c5857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a259cf4b240fba9b065a43b2ed4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:18:12.033953 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-2187b662-02bf-40eb-8caa-eca1a760835b tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] 10.222.0.58 "GET /compute/v2.1/servers/80714390-c8b6-4703-a02a-d41fafad3540" status: 200 len: 1578 microversion: 2.1 time: 0.182601 Jul 21 20:18:12.034782 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 535/1087] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:18:11 2022] GET /compute/v2.1/servers/80714390-c8b6-4703-a02a-d41fafad3540 => generated 1578 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:18:12.415551 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-e66044de-444f-4007-9045-283779b9e2bb tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:18:12.416156 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-e66044de-444f-4007-9045-283779b9e2bb tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] [instance: 25c00062-b8e5-4575-a993-bcace67b3682] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:18:12.422139 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e66044de-444f-4007-9045-283779b9e2bb tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:12.422585 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e66044de-444f-4007-9045-283779b9e2bb tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:12.423380 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e66044de-444f-4007-9045-283779b9e2bb tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:12.423816 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e66044de-444f-4007-9045-283779b9e2bb tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:12.724051 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-e66044de-444f-4007-9045-283779b9e2bb tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216eb0b454534a878c30a23e9126ff9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c262cd918784d6490dcd78eda61c551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:18:12.732448 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-e66044de-444f-4007-9045-283779b9e2bb tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] 10.222.0.58 "GET /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682" status: 200 len: 1358 microversion: 2.1 time: 0.321468 Jul 21 20:18:12.734442 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 553/1088] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:18:12 2022] GET /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682 => generated 1358 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:18:12.893977 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-96fecad2-3f1d-413a-af4a-f8378ed22243 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:18:12.895088 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-96fecad2-3f1d-413a-af4a-f8378ed22243 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] [instance: 6088dba0-f178-48c2-8fed-1e0c93d88aed] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:18:12.903880 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-96fecad2-3f1d-413a-af4a-f8378ed22243 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:12.904331 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-96fecad2-3f1d-413a-af4a-f8378ed22243 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:12.905959 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-96fecad2-3f1d-413a-af4a-f8378ed22243 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:12.906396 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-96fecad2-3f1d-413a-af4a-f8378ed22243 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:12.970182 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-96fecad2-3f1d-413a-af4a-f8378ed22243 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f41baf9558b04546aaa5bf112e4c4fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9872332c8270445f9feacb0d76982f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:18:12.978497 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-96fecad2-3f1d-413a-af4a-f8378ed22243 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] 10.222.0.58 "GET /compute/v2.1/servers/6088dba0-f178-48c2-8fed-1e0c93d88aed" status: 200 len: 1218 microversion: 2.1 time: 0.089020 Jul 21 20:18:12.979482 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 536/1089] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:18:12 2022] GET /compute/v2.1/servers/6088dba0-f178-48c2-8fed-1e0c93d88aed => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:18:13.053521 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-27274f8f-c315-493e-b674-aaddca62705d tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:18:13.054172 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-27274f8f-c315-493e-b674-aaddca62705d tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] [instance: 80714390-c8b6-4703-a02a-d41fafad3540] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:18:13.061198 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-27274f8f-c315-493e-b674-aaddca62705d tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:13.061648 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-27274f8f-c315-493e-b674-aaddca62705d tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:13.062417 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-27274f8f-c315-493e-b674-aaddca62705d tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:13.062852 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-27274f8f-c315-493e-b674-aaddca62705d tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:13.209904 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-27274f8f-c315-493e-b674-aaddca62705d tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4460571d9294e38931274a55c6c5857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a259cf4b240fba9b065a43b2ed4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:18:13.212578 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-27274f8f-c315-493e-b674-aaddca62705d tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] 10.222.0.58 "GET /compute/v2.1/servers/80714390-c8b6-4703-a02a-d41fafad3540" status: 200 len: 1578 microversion: 2.1 time: 0.163575 Jul 21 20:18:13.213253 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 554/1090] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:18:13 2022] GET /compute/v2.1/servers/80714390-c8b6-4703-a02a-d41fafad3540 => generated 1578 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:18:13.749333 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-6d20b084-28d2-43b9-859f-cac8db430e5e tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:18:13.759482 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-6d20b084-28d2-43b9-859f-cac8db430e5e tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] [instance: 25c00062-b8e5-4575-a993-bcace67b3682] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:18:13.764303 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-6d20b084-28d2-43b9-859f-cac8db430e5e tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:13.764799 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-6d20b084-28d2-43b9-859f-cac8db430e5e tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:13.765689 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-6d20b084-28d2-43b9-859f-cac8db430e5e tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:13.766147 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-6d20b084-28d2-43b9-859f-cac8db430e5e tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:13.904097 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-6d20b084-28d2-43b9-859f-cac8db430e5e tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216eb0b454534a878c30a23e9126ff9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c262cd918784d6490dcd78eda61c551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:18:13.912661 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-6d20b084-28d2-43b9-859f-cac8db430e5e tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] 10.222.0.58 "GET /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682" status: 200 len: 1358 microversion: 2.1 time: 0.167198 Jul 21 20:18:13.913358 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 537/1091] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:18:13 2022] GET /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:18:13.996074 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-4ec7f66a-6dbe-4d09-a0a9-32323e0e438b tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:18:13.999791 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-4ec7f66a-6dbe-4d09-a0a9-32323e0e438b tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] [instance: 6088dba0-f178-48c2-8fed-1e0c93d88aed] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:18:14.002947 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4ec7f66a-6dbe-4d09-a0a9-32323e0e438b tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:14.003421 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4ec7f66a-6dbe-4d09-a0a9-32323e0e438b tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:14.004216 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4ec7f66a-6dbe-4d09-a0a9-32323e0e438b tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:14.004645 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4ec7f66a-6dbe-4d09-a0a9-32323e0e438b tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:14.072310 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-4ec7f66a-6dbe-4d09-a0a9-32323e0e438b tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f41baf9558b04546aaa5bf112e4c4fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9872332c8270445f9feacb0d76982f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:18:14.079667 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-4ec7f66a-6dbe-4d09-a0a9-32323e0e438b tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] 10.222.0.58 "GET /compute/v2.1/servers/6088dba0-f178-48c2-8fed-1e0c93d88aed" status: 200 len: 1218 microversion: 2.1 time: 0.088341 Jul 21 20:18:14.080218 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 555/1092] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:18:13 2022] GET /compute/v2.1/servers/6088dba0-f178-48c2-8fed-1e0c93d88aed => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:18:14.230124 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-413ceee4-8f5f-4c56-b608-969a904a9d27 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:18:14.230726 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-413ceee4-8f5f-4c56-b608-969a904a9d27 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] [instance: 80714390-c8b6-4703-a02a-d41fafad3540] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:18:14.236676 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-413ceee4-8f5f-4c56-b608-969a904a9d27 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:14.237646 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-413ceee4-8f5f-4c56-b608-969a904a9d27 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:14.237879 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-413ceee4-8f5f-4c56-b608-969a904a9d27 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:14.238307 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-413ceee4-8f5f-4c56-b608-969a904a9d27 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:14.375245 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-413ceee4-8f5f-4c56-b608-969a904a9d27 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4460571d9294e38931274a55c6c5857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a259cf4b240fba9b065a43b2ed4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:18:14.385156 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-413ceee4-8f5f-4c56-b608-969a904a9d27 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] 10.222.0.58 "GET /compute/v2.1/servers/80714390-c8b6-4703-a02a-d41fafad3540" status: 200 len: 1578 microversion: 2.1 time: 0.159211 Jul 21 20:18:14.385632 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 538/1093] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:18:14 2022] GET /compute/v2.1/servers/80714390-c8b6-4703-a02a-d41fafad3540 => generated 1578 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:18:14.929569 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-67683e4b-7f3a-4cb9-b675-a4b9c90c293f tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:18:14.930837 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-67683e4b-7f3a-4cb9-b675-a4b9c90c293f tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] [instance: 25c00062-b8e5-4575-a993-bcace67b3682] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:18:14.936855 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-67683e4b-7f3a-4cb9-b675-a4b9c90c293f tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:14.937298 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-67683e4b-7f3a-4cb9-b675-a4b9c90c293f tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:14.938049 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-67683e4b-7f3a-4cb9-b675-a4b9c90c293f tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:14.938479 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-67683e4b-7f3a-4cb9-b675-a4b9c90c293f tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:15.066491 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-67683e4b-7f3a-4cb9-b675-a4b9c90c293f tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216eb0b454534a878c30a23e9126ff9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c262cd918784d6490dcd78eda61c551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:18:15.073908 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-67683e4b-7f3a-4cb9-b675-a4b9c90c293f tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] 10.222.0.58 "GET /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682" status: 200 len: 1358 microversion: 2.1 time: 0.148302 Jul 21 20:18:15.074491 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 556/1094] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:18:14 2022] GET /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682 => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:18:15.096751 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-5b353df4-8210-4f68-9edd-8a90372fa8e5 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:18:15.097363 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-5b353df4-8210-4f68-9edd-8a90372fa8e5 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] [instance: 6088dba0-f178-48c2-8fed-1e0c93d88aed] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:18:15.104422 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-5b353df4-8210-4f68-9edd-8a90372fa8e5 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:15.104871 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-5b353df4-8210-4f68-9edd-8a90372fa8e5 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:15.105634 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-5b353df4-8210-4f68-9edd-8a90372fa8e5 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:15.106071 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-5b353df4-8210-4f68-9edd-8a90372fa8e5 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:15.166530 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-5b353df4-8210-4f68-9edd-8a90372fa8e5 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f41baf9558b04546aaa5bf112e4c4fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9872332c8270445f9feacb0d76982f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:18:15.173981 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-5b353df4-8210-4f68-9edd-8a90372fa8e5 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] 10.222.0.58 "GET /compute/v2.1/servers/6088dba0-f178-48c2-8fed-1e0c93d88aed" status: 200 len: 1218 microversion: 2.1 time: 0.081305 Jul 21 20:18:15.174537 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 539/1095] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:18:15 2022] GET /compute/v2.1/servers/6088dba0-f178-48c2-8fed-1e0c93d88aed => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:18:15.402671 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-0495e305-6b8b-4259-a5e1-2ce3356f7826 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:18:15.403312 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-0495e305-6b8b-4259-a5e1-2ce3356f7826 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] [instance: 80714390-c8b6-4703-a02a-d41fafad3540] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:18:15.409404 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0495e305-6b8b-4259-a5e1-2ce3356f7826 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:15.409862 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0495e305-6b8b-4259-a5e1-2ce3356f7826 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:15.410611 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0495e305-6b8b-4259-a5e1-2ce3356f7826 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:15.411062 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0495e305-6b8b-4259-a5e1-2ce3356f7826 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:15.541778 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-0495e305-6b8b-4259-a5e1-2ce3356f7826 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4460571d9294e38931274a55c6c5857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a259cf4b240fba9b065a43b2ed4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:18:15.549231 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-0495e305-6b8b-4259-a5e1-2ce3356f7826 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] 10.222.0.58 "GET /compute/v2.1/servers/80714390-c8b6-4703-a02a-d41fafad3540" status: 200 len: 1578 microversion: 2.1 time: 0.150911 Jul 21 20:18:15.549787 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 557/1096] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:18:15 2022] GET /compute/v2.1/servers/80714390-c8b6-4703-a02a-d41fafad3540 => generated 1578 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:18:16.090987 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-e64494d7-a268-41fb-a160-901c5229b40b tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:18:16.091619 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-e64494d7-a268-41fb-a160-901c5229b40b tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] [instance: 25c00062-b8e5-4575-a993-bcace67b3682] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:18:16.097991 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-e64494d7-a268-41fb-a160-901c5229b40b tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:16.098544 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-e64494d7-a268-41fb-a160-901c5229b40b tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:16.099228 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-e64494d7-a268-41fb-a160-901c5229b40b tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:16.099663 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-e64494d7-a268-41fb-a160-901c5229b40b tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:16.191497 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-ac934730-dc47-48c8-b256-338ea6a84d83 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:18:16.194806 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-ac934730-dc47-48c8-b256-338ea6a84d83 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] [instance: 6088dba0-f178-48c2-8fed-1e0c93d88aed] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:18:16.198961 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ac934730-dc47-48c8-b256-338ea6a84d83 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:16.199437 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ac934730-dc47-48c8-b256-338ea6a84d83 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:16.200203 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ac934730-dc47-48c8-b256-338ea6a84d83 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:16.200642 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ac934730-dc47-48c8-b256-338ea6a84d83 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:16.230830 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-e64494d7-a268-41fb-a160-901c5229b40b tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216eb0b454534a878c30a23e9126ff9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c262cd918784d6490dcd78eda61c551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:18:16.233208 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG dbcounter [-] [118344] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:18:16.239196 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-e64494d7-a268-41fb-a160-901c5229b40b tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] 10.222.0.58 "GET /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682" status: 200 len: 1358 microversion: 2.1 time: 0.152054 Jul 21 20:18:16.239779 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 540/1097] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:18:16 2022] GET /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:18:16.263398 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-ac934730-dc47-48c8-b256-338ea6a84d83 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f41baf9558b04546aaa5bf112e4c4fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9872332c8270445f9feacb0d76982f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:18:16.270918 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-ac934730-dc47-48c8-b256-338ea6a84d83 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] 10.222.0.58 "GET /compute/v2.1/servers/6088dba0-f178-48c2-8fed-1e0c93d88aed" status: 200 len: 1218 microversion: 2.1 time: 0.083267 Jul 21 20:18:16.271524 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 558/1098] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:18:16 2022] GET /compute/v2.1/servers/6088dba0-f178-48c2-8fed-1e0c93d88aed => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:18:16.566139 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-571ea904-9c6a-48fc-9eb2-0b0a1deb2da2 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:18:16.566780 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-571ea904-9c6a-48fc-9eb2-0b0a1deb2da2 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] [instance: 80714390-c8b6-4703-a02a-d41fafad3540] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:18:16.574061 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-571ea904-9c6a-48fc-9eb2-0b0a1deb2da2 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:16.574512 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-571ea904-9c6a-48fc-9eb2-0b0a1deb2da2 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:16.575300 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-571ea904-9c6a-48fc-9eb2-0b0a1deb2da2 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:16.575737 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-571ea904-9c6a-48fc-9eb2-0b0a1deb2da2 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:16.705629 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-571ea904-9c6a-48fc-9eb2-0b0a1deb2da2 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4460571d9294e38931274a55c6c5857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a259cf4b240fba9b065a43b2ed4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:18:16.713458 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-571ea904-9c6a-48fc-9eb2-0b0a1deb2da2 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] 10.222.0.58 "GET /compute/v2.1/servers/80714390-c8b6-4703-a02a-d41fafad3540" status: 200 len: 1578 microversion: 2.1 time: 0.151230 Jul 21 20:18:16.714023 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 541/1099] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:18:16 2022] GET /compute/v2.1/servers/80714390-c8b6-4703-a02a-d41fafad3540 => generated 1578 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:18:17.256562 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-acd36022-ec8d-4443-9ac2-224407ad7c55 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:18:17.257098 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-acd36022-ec8d-4443-9ac2-224407ad7c55 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] [instance: 25c00062-b8e5-4575-a993-bcace67b3682] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:18:17.263511 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-acd36022-ec8d-4443-9ac2-224407ad7c55 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:17.263950 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-acd36022-ec8d-4443-9ac2-224407ad7c55 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:17.264704 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-acd36022-ec8d-4443-9ac2-224407ad7c55 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:17.265125 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-acd36022-ec8d-4443-9ac2-224407ad7c55 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:17.288520 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-1939ba47-7cbe-4ab6-afb6-4a8f5fdd7b42 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:18:17.289659 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-1939ba47-7cbe-4ab6-afb6-4a8f5fdd7b42 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] [instance: 6088dba0-f178-48c2-8fed-1e0c93d88aed] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:18:17.296318 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-1939ba47-7cbe-4ab6-afb6-4a8f5fdd7b42 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:17.296770 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-1939ba47-7cbe-4ab6-afb6-4a8f5fdd7b42 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:17.297571 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-1939ba47-7cbe-4ab6-afb6-4a8f5fdd7b42 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:17.298010 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-1939ba47-7cbe-4ab6-afb6-4a8f5fdd7b42 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:17.363054 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-1939ba47-7cbe-4ab6-afb6-4a8f5fdd7b42 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f41baf9558b04546aaa5bf112e4c4fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9872332c8270445f9feacb0d76982f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:18:17.370217 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-1939ba47-7cbe-4ab6-afb6-4a8f5fdd7b42 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] 10.222.0.58 "GET /compute/v2.1/servers/6088dba0-f178-48c2-8fed-1e0c93d88aed" status: 200 len: 1210 microversion: 2.1 time: 0.085858 Jul 21 20:18:17.370807 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 542/1100] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:18:17 2022] GET /compute/v2.1/servers/6088dba0-f178-48c2-8fed-1e0c93d88aed => generated 1210 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:18:17.398776 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-acd36022-ec8d-4443-9ac2-224407ad7c55 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216eb0b454534a878c30a23e9126ff9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c262cd918784d6490dcd78eda61c551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:18:17.406441 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-acd36022-ec8d-4443-9ac2-224407ad7c55 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] 10.222.0.58 "GET /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682" status: 200 len: 1358 microversion: 2.1 time: 0.153900 Jul 21 20:18:17.406995 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 559/1101] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:18:17 2022] GET /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:18:17.731635 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-806d0677-ed57-463d-8474-3b9fc2afe9d3 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:18:17.732287 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-806d0677-ed57-463d-8474-3b9fc2afe9d3 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] [instance: 80714390-c8b6-4703-a02a-d41fafad3540] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:18:17.738281 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-806d0677-ed57-463d-8474-3b9fc2afe9d3 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:17.738739 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-806d0677-ed57-463d-8474-3b9fc2afe9d3 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:17.739537 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-806d0677-ed57-463d-8474-3b9fc2afe9d3 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:17.739978 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-806d0677-ed57-463d-8474-3b9fc2afe9d3 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:17.867444 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-806d0677-ed57-463d-8474-3b9fc2afe9d3 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4460571d9294e38931274a55c6c5857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a259cf4b240fba9b065a43b2ed4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:18:17.874860 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-806d0677-ed57-463d-8474-3b9fc2afe9d3 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] 10.222.0.58 "GET /compute/v2.1/servers/80714390-c8b6-4703-a02a-d41fafad3540" status: 200 len: 1578 microversion: 2.1 time: 0.147197 Jul 21 20:18:17.875443 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 543/1102] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:18:17 2022] GET /compute/v2.1/servers/80714390-c8b6-4703-a02a-d41fafad3540 => generated 1578 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:18:18.388203 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-51ccf3ab-f9ea-4210-bbc7-2cf0078666e3 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:18:18.436351 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-51ccf3ab-f9ea-4210-bbc7-2cf0078666e3 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] [instance: 6088dba0-f178-48c2-8fed-1e0c93d88aed] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:18:18.436351 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell0:SELECT=4 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:18:18.436351 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell0:SELECT=12 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:18:18.436351 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-51ccf3ab-f9ea-4210-bbc7-2cf0078666e3 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:18.436351 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-51ccf3ab-f9ea-4210-bbc7-2cf0078666e3 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:18.436884 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-51ccf3ab-f9ea-4210-bbc7-2cf0078666e3 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:18.436884 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-51ccf3ab-f9ea-4210-bbc7-2cf0078666e3 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:18.437056 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-ee675bb6-cf97-4594-81e4-f5f2e43dd4c0 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:18:18.437056 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-ee675bb6-cf97-4594-81e4-f5f2e43dd4c0 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] [instance: 25c00062-b8e5-4575-a993-bcace67b3682] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:18:18.437056 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-ee675bb6-cf97-4594-81e4-f5f2e43dd4c0 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:18.437056 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-ee675bb6-cf97-4594-81e4-f5f2e43dd4c0 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:18.437765 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-ee675bb6-cf97-4594-81e4-f5f2e43dd4c0 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:18.437765 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-ee675bb6-cf97-4594-81e4-f5f2e43dd4c0 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:18.463812 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-51ccf3ab-f9ea-4210-bbc7-2cf0078666e3 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f41baf9558b04546aaa5bf112e4c4fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9872332c8270445f9feacb0d76982f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:18:18.472215 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-51ccf3ab-f9ea-4210-bbc7-2cf0078666e3 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] 10.222.0.58 "GET /compute/v2.1/servers/6088dba0-f178-48c2-8fed-1e0c93d88aed" status: 200 len: 1266 microversion: 2.1 time: 0.088168 Jul 21 20:18:18.473821 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 560/1103] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:18:18 2022] GET /compute/v2.1/servers/6088dba0-f178-48c2-8fed-1e0c93d88aed => generated 1266 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:18:18.530217 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG dbcounter [-] [118344] Writing DB stats nova_cell0:SELECT=8 {{(pid=118344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:18:18.599509 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-ee675bb6-cf97-4594-81e4-f5f2e43dd4c0 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216eb0b454534a878c30a23e9126ff9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c262cd918784d6490dcd78eda61c551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:18:18.604635 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-ee675bb6-cf97-4594-81e4-f5f2e43dd4c0 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] 10.222.0.58 "GET /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682" status: 200 len: 1358 microversion: 2.1 time: 0.184941 Jul 21 20:18:18.605188 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 544/1104] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:18:18 2022] GET /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682 => generated 1358 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:18:18.893359 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-512d83ca-8196-405c-b13c-8f3f0f520a03 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:18:18.894293 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-512d83ca-8196-405c-b13c-8f3f0f520a03 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] [instance: 80714390-c8b6-4703-a02a-d41fafad3540] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:18:18.900957 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-512d83ca-8196-405c-b13c-8f3f0f520a03 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:18.901621 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-512d83ca-8196-405c-b13c-8f3f0f520a03 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:18.902577 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-512d83ca-8196-405c-b13c-8f3f0f520a03 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:18.903654 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-512d83ca-8196-405c-b13c-8f3f0f520a03 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:19.041843 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-512d83ca-8196-405c-b13c-8f3f0f520a03 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4460571d9294e38931274a55c6c5857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a259cf4b240fba9b065a43b2ed4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:18:19.049268 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-512d83ca-8196-405c-b13c-8f3f0f520a03 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] 10.222.0.58 "GET /compute/v2.1/servers/80714390-c8b6-4703-a02a-d41fafad3540" status: 200 len: 1578 microversion: 2.1 time: 0.160682 Jul 21 20:18:19.049935 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 561/1105] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:18:18 2022] GET /compute/v2.1/servers/80714390-c8b6-4703-a02a-d41fafad3540 => generated 1578 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:18:19.490080 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-1c513680-20c8-4b43-b91b-51aebce859dd tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:18:19.490934 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-1c513680-20c8-4b43-b91b-51aebce859dd tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] [instance: 6088dba0-f178-48c2-8fed-1e0c93d88aed] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:18:19.502668 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-1c513680-20c8-4b43-b91b-51aebce859dd tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:19.506343 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-1c513680-20c8-4b43-b91b-51aebce859dd tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:19.506343 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-1c513680-20c8-4b43-b91b-51aebce859dd tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:19.506343 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-1c513680-20c8-4b43-b91b-51aebce859dd tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:19.573634 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-1c513680-20c8-4b43-b91b-51aebce859dd tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f41baf9558b04546aaa5bf112e4c4fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9872332c8270445f9feacb0d76982f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:18:19.581208 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-1c513680-20c8-4b43-b91b-51aebce859dd tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] 10.222.0.58 "GET /compute/v2.1/servers/6088dba0-f178-48c2-8fed-1e0c93d88aed" status: 200 len: 1274 microversion: 2.1 time: 0.095405 Jul 21 20:18:19.581771 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 545/1106] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:18:19 2022] GET /compute/v2.1/servers/6088dba0-f178-48c2-8fed-1e0c93d88aed => generated 1274 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:18:19.622012 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-0e881cff-57bf-4390-b284-abfafb0cf032 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:18:19.622857 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-0e881cff-57bf-4390-b284-abfafb0cf032 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] [instance: 25c00062-b8e5-4575-a993-bcace67b3682] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:18:19.629341 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0e881cff-57bf-4390-b284-abfafb0cf032 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:19.629874 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0e881cff-57bf-4390-b284-abfafb0cf032 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:19.630786 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0e881cff-57bf-4390-b284-abfafb0cf032 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:19.631252 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0e881cff-57bf-4390-b284-abfafb0cf032 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:19.838672 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-0e881cff-57bf-4390-b284-abfafb0cf032 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216eb0b454534a878c30a23e9126ff9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c262cd918784d6490dcd78eda61c551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:18:19.842080 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell1:SELECT=100 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:18:19.846790 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-0e881cff-57bf-4390-b284-abfafb0cf032 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] 10.222.0.58 "GET /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682" status: 200 len: 1358 microversion: 2.1 time: 0.229351 Jul 21 20:18:19.847414 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 562/1107] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:18:19 2022] GET /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682 => generated 1358 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:18:20.068432 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-70c18848-def0-41af-8d54-c37f06dfac06 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:18:20.069295 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-70c18848-def0-41af-8d54-c37f06dfac06 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] [instance: 80714390-c8b6-4703-a02a-d41fafad3540] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:18:20.081190 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-70c18848-def0-41af-8d54-c37f06dfac06 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:20.081805 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-70c18848-def0-41af-8d54-c37f06dfac06 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:20.083443 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-70c18848-def0-41af-8d54-c37f06dfac06 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:20.084103 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-70c18848-def0-41af-8d54-c37f06dfac06 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:20.137938 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [req-2195a237-607d-4990-8b0d-9ed1fd2d7317 req-a7c64994-1c47-4ba3-b952-d7394e6d2120 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80714390-c8b6-4703-a02a-d41fafad3540", "name": "network-vif-deleted", "tag": "3dca572c-2bd0-4b29-aed9-3c6afedba8c9"}]} {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:18:20.151657 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [req-2195a237-607d-4990-8b0d-9ed1fd2d7317 req-a7c64994-1c47-4ba3-b952-d7394e6d2120 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:20.156500 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [req-2195a237-607d-4990-8b0d-9ed1fd2d7317 req-a7c64994-1c47-4ba3-b952-d7394e6d2120 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:20.160015 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-70c18848-def0-41af-8d54-c37f06dfac06 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4460571d9294e38931274a55c6c5857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a259cf4b240fba9b065a43b2ed4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:18:20.169535 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-70c18848-def0-41af-8d54-c37f06dfac06 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] 10.222.0.58 "GET /compute/v2.1/servers/80714390-c8b6-4703-a02a-d41fafad3540" status: 200 len: 1510 microversion: 2.1 time: 0.107173 Jul 21 20:18:20.170342 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.compute.server_external_events [req-2195a237-607d-4990-8b0d-9ed1fd2d7317 req-a7c64994-1c47-4ba3-b952-d7394e6d2120 service nova] Creating event network-vif-deleted:3dca572c-2bd0-4b29-aed9-3c6afedba8c9 for instance 80714390-c8b6-4703-a02a-d41fafad3540 on hv-cinder-85054 Jul 21 20:18:20.177926 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [req-2195a237-607d-4990-8b0d-9ed1fd2d7317 req-a7c64994-1c47-4ba3-b952-d7394e6d2120 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.182346 Jul 21 20:18:20.178870 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 546/1108] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 20:18:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:18:20.182953 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 563/1109] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:18:20 2022] GET /compute/v2.1/servers/80714390-c8b6-4703-a02a-d41fafad3540 => generated 1510 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:18:20.598943 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-62aaf2ab-f2fe-4382-92be-bc1ab7022d26 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:18:20.599779 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-62aaf2ab-f2fe-4382-92be-bc1ab7022d26 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] [instance: 6088dba0-f178-48c2-8fed-1e0c93d88aed] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:18:20.606075 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-62aaf2ab-f2fe-4382-92be-bc1ab7022d26 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:20.606518 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-62aaf2ab-f2fe-4382-92be-bc1ab7022d26 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:20.607318 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-62aaf2ab-f2fe-4382-92be-bc1ab7022d26 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:20.607849 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-62aaf2ab-f2fe-4382-92be-bc1ab7022d26 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:20.673719 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-62aaf2ab-f2fe-4382-92be-bc1ab7022d26 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f41baf9558b04546aaa5bf112e4c4fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9872332c8270445f9feacb0d76982f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:18:20.682145 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-62aaf2ab-f2fe-4382-92be-bc1ab7022d26 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] 10.222.0.58 "GET /compute/v2.1/servers/6088dba0-f178-48c2-8fed-1e0c93d88aed" status: 200 len: 1274 microversion: 2.1 time: 0.088152 Jul 21 20:18:20.682715 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 547/1110] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:18:20 2022] GET /compute/v2.1/servers/6088dba0-f178-48c2-8fed-1e0c93d88aed => generated 1274 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:18:20.864115 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-41f6e69e-0e13-490b-a013-9110b1ed5f09 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:18:20.864730 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-41f6e69e-0e13-490b-a013-9110b1ed5f09 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] [instance: 25c00062-b8e5-4575-a993-bcace67b3682] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:18:20.871946 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-41f6e69e-0e13-490b-a013-9110b1ed5f09 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:20.872396 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-41f6e69e-0e13-490b-a013-9110b1ed5f09 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:20.873199 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-41f6e69e-0e13-490b-a013-9110b1ed5f09 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:20.873635 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-41f6e69e-0e13-490b-a013-9110b1ed5f09 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:21.007042 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-41f6e69e-0e13-490b-a013-9110b1ed5f09 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216eb0b454534a878c30a23e9126ff9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c262cd918784d6490dcd78eda61c551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:18:21.014872 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-41f6e69e-0e13-490b-a013-9110b1ed5f09 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] 10.222.0.58 "GET /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682" status: 200 len: 1358 microversion: 2.1 time: 0.154501 Jul 21 20:18:21.015480 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 564/1111] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:18:20 2022] GET /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:18:21.186949 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-abde98c5-23e9-4f57-bd7a-60e5c145e5b5 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:18:21.187635 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-abde98c5-23e9-4f57-bd7a-60e5c145e5b5 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] [instance: 80714390-c8b6-4703-a02a-d41fafad3540] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:18:21.193605 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-abde98c5-23e9-4f57-bd7a-60e5c145e5b5 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:21.194054 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-abde98c5-23e9-4f57-bd7a-60e5c145e5b5 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:21.194810 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-abde98c5-23e9-4f57-bd7a-60e5c145e5b5 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:21.195267 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-abde98c5-23e9-4f57-bd7a-60e5c145e5b5 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:21.255639 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-abde98c5-23e9-4f57-bd7a-60e5c145e5b5 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4460571d9294e38931274a55c6c5857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a259cf4b240fba9b065a43b2ed4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:18:21.263423 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-abde98c5-23e9-4f57-bd7a-60e5c145e5b5 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] 10.222.0.58 "GET /compute/v2.1/servers/80714390-c8b6-4703-a02a-d41fafad3540" status: 200 len: 1510 microversion: 2.1 time: 0.080342 Jul 21 20:18:21.264019 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 548/1112] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:18:21 2022] GET /compute/v2.1/servers/80714390-c8b6-4703-a02a-d41fafad3540 => generated 1510 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:18:21.699086 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-ddb14faf-d465-4ab4-a064-95a6997e146d tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:18:21.699698 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-ddb14faf-d465-4ab4-a064-95a6997e146d tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] [instance: 6088dba0-f178-48c2-8fed-1e0c93d88aed] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:18:21.706029 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ddb14faf-d465-4ab4-a064-95a6997e146d tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:21.706479 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ddb14faf-d465-4ab4-a064-95a6997e146d tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:21.707340 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ddb14faf-d465-4ab4-a064-95a6997e146d tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:21.707774 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ddb14faf-d465-4ab4-a064-95a6997e146d tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:21.783979 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-ddb14faf-d465-4ab4-a064-95a6997e146d tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f41baf9558b04546aaa5bf112e4c4fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9872332c8270445f9feacb0d76982f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:18:21.792154 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-ddb14faf-d465-4ab4-a064-95a6997e146d tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] 10.222.0.58 "GET /compute/v2.1/servers/6088dba0-f178-48c2-8fed-1e0c93d88aed" status: 200 len: 1272 microversion: 2.1 time: 0.097038 Jul 21 20:18:21.801846 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 565/1113] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:18:21 2022] GET /compute/v2.1/servers/6088dba0-f178-48c2-8fed-1e0c93d88aed => generated 1272 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:18:22.031835 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-2e63f698-a7b4-4c30-9acb-f063884a755a tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:18:22.032546 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-2e63f698-a7b4-4c30-9acb-f063884a755a tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] [instance: 25c00062-b8e5-4575-a993-bcace67b3682] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:18:22.038794 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-2e63f698-a7b4-4c30-9acb-f063884a755a tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:22.044924 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-2e63f698-a7b4-4c30-9acb-f063884a755a tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:22.044924 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-2e63f698-a7b4-4c30-9acb-f063884a755a tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:22.044924 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-2e63f698-a7b4-4c30-9acb-f063884a755a tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:22.216261 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-2e63f698-a7b4-4c30-9acb-f063884a755a tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216eb0b454534a878c30a23e9126ff9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c262cd918784d6490dcd78eda61c551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:18:22.233933 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-2e63f698-a7b4-4c30-9acb-f063884a755a tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] 10.222.0.58 "GET /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682" status: 200 len: 1358 microversion: 2.1 time: 0.205970 Jul 21 20:18:22.234512 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 549/1114] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:18:22 2022] GET /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682 => generated 1358 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:18:22.281707 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-649fa435-f6c0-4f84-bf31-6c4a5deb5fac tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:18:22.282363 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-649fa435-f6c0-4f84-bf31-6c4a5deb5fac tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] [instance: 80714390-c8b6-4703-a02a-d41fafad3540] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:18:22.290903 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-649fa435-f6c0-4f84-bf31-6c4a5deb5fac tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:22.291454 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-649fa435-f6c0-4f84-bf31-6c4a5deb5fac tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:22.292462 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-649fa435-f6c0-4f84-bf31-6c4a5deb5fac tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:22.292913 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-649fa435-f6c0-4f84-bf31-6c4a5deb5fac tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:22.325368 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-649fa435-f6c0-4f84-bf31-6c4a5deb5fac tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:22.325822 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-649fa435-f6c0-4f84-bf31-6c4a5deb5fac tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:22.326263 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.objects.instance [None req-649fa435-f6c0-4f84-bf31-6c4a5deb5fac tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lazy-loading 'fault' on Instance uuid 80714390-c8b6-4703-a02a-d41fafad3540 {{(pid=118345) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 20:18:22.371234 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-649fa435-f6c0-4f84-bf31-6c4a5deb5fac tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4460571d9294e38931274a55c6c5857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a259cf4b240fba9b065a43b2ed4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:18:22.378954 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-649fa435-f6c0-4f84-bf31-6c4a5deb5fac tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] 10.222.0.58 "GET /compute/v2.1/servers/80714390-c8b6-4703-a02a-d41fafad3540" status: 200 len: 1230 microversion: 2.1 time: 0.101165 Jul 21 20:18:22.379603 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 566/1115] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:18:22 2022] GET /compute/v2.1/servers/80714390-c8b6-4703-a02a-d41fafad3540 => generated 1230 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:18:22.810726 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-8d0041bc-fdd5-49e8-ad92-4ec48709ea92 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:18:22.811907 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-8d0041bc-fdd5-49e8-ad92-4ec48709ea92 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] [instance: 6088dba0-f178-48c2-8fed-1e0c93d88aed] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:18:22.820454 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-8d0041bc-fdd5-49e8-ad92-4ec48709ea92 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:22.820901 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-8d0041bc-fdd5-49e8-ad92-4ec48709ea92 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:22.821724 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-8d0041bc-fdd5-49e8-ad92-4ec48709ea92 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:22.822145 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-8d0041bc-fdd5-49e8-ad92-4ec48709ea92 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:22.863469 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 20:18:22.865494 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Thu Jul 21 20:18:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6088dba0-f178-48c2-8fed-1e0c93d88aed (ip 10.222.0.58) !!! Jul 21 20:18:23.026575 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-8d0041bc-fdd5-49e8-ad92-4ec48709ea92 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f41baf9558b04546aaa5bf112e4c4fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9872332c8270445f9feacb0d76982f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:18:23.034001 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-8d0041bc-fdd5-49e8-ad92-4ec48709ea92 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] 10.222.0.58 "GET /compute/v2.1/servers/6088dba0-f178-48c2-8fed-1e0c93d88aed" status: 200 len: 1314 microversion: 2.1 time: 0.228961 Jul 21 20:18:23.034837 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 550/1116] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:18:22 2022] GET /compute/v2.1/servers/6088dba0-f178-48c2-8fed-1e0c93d88aed => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:18:23.131984 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [req-a9e39d7d-c455-4f41-aea3-ff3be9a77518 req-b148dae6-79d9-45c1-a9a4-7975a9f4fff1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6088dba0-f178-48c2-8fed-1e0c93d88aed", "tag": "314e87d8-22d0-4600-adfe-f451a20d6dff"}]} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:18:23.141015 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-a9e39d7d-c455-4f41-aea3-ff3be9a77518 req-b148dae6-79d9-45c1-a9a4-7975a9f4fff1 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:23.148933 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-a9e39d7d-c455-4f41-aea3-ff3be9a77518 req-b148dae6-79d9-45c1-a9a4-7975a9f4fff1 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:23.156084 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.compute.server_external_events [req-a9e39d7d-c455-4f41-aea3-ff3be9a77518 req-b148dae6-79d9-45c1-a9a4-7975a9f4fff1 service nova] Creating event network-changed:314e87d8-22d0-4600-adfe-f451a20d6dff for instance 6088dba0-f178-48c2-8fed-1e0c93d88aed on hv-cinder-85054 Jul 21 20:18:23.161633 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [req-a9e39d7d-c455-4f41-aea3-ff3be9a77518 req-b148dae6-79d9-45c1-a9a4-7975a9f4fff1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034096 Jul 21 20:18:23.162463 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 567/1117] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 20:18:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:18:23.250805 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-f3c6602a-f721-4bfd-8ab6-d03005c21fd3 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:18:23.251744 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-f3c6602a-f721-4bfd-8ab6-d03005c21fd3 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] [instance: 25c00062-b8e5-4575-a993-bcace67b3682] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:18:23.259845 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f3c6602a-f721-4bfd-8ab6-d03005c21fd3 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:23.260296 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f3c6602a-f721-4bfd-8ab6-d03005c21fd3 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:23.261162 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f3c6602a-f721-4bfd-8ab6-d03005c21fd3 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:23.261564 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f3c6602a-f721-4bfd-8ab6-d03005c21fd3 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:23.399112 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-f6323e98-51d3-4e2f-9deb-28e76cdd9843 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:18:23.399112 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-f6323e98-51d3-4e2f-9deb-28e76cdd9843 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] [instance: 80714390-c8b6-4703-a02a-d41fafad3540] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:18:23.406809 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f6323e98-51d3-4e2f-9deb-28e76cdd9843 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:23.407294 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f6323e98-51d3-4e2f-9deb-28e76cdd9843 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:23.408077 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f6323e98-51d3-4e2f-9deb-28e76cdd9843 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:23.408513 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f6323e98-51d3-4e2f-9deb-28e76cdd9843 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:23.424164 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.wsgi [None req-f6323e98-51d3-4e2f-9deb-28e76cdd9843 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] HTTP exception thrown: Instance 80714390-c8b6-4703-a02a-d41fafad3540 could not be found. Jul 21 20:18:23.425831 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-f6323e98-51d3-4e2f-9deb-28e76cdd9843 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Request method failure captured: Jul 21 20:18:23.425831 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: request: GET /compute/v2.1/servers/80714390-c8b6-4703-a02a-d41fafad3540 HTTP/1.1 Jul 21 20:18:23.425831 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Accept: application/json Jul 21 20:18:23.425831 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Accept-Encoding: identity Jul 21 20:18:23.425831 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Connection: close Jul 21 20:18:23.425831 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Content-Length: 0 Jul 21 20:18:23.425831 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Content-Type: application/json Jul 21 20:18:23.425831 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Host: 10.222.0.58 Jul 21 20:18:23.425831 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Openstack-System-Scope: None Jul 21 20:18:23.425831 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: User-Agent: python-urllib3/1.26.9 Jul 21 20:18:23.425831 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Auth-Token: gAAAAABi2bOyAPgMcq3UH_A-sF4JTb4-D2XU515CwZP3flz-yPGmNuW-WbHKMutbYGqceV-QgEIrlFw_80cA596KMvmuSaIhtFCFUyelSoS3JtQvR1SMSP71XOPqUd2JDsIi9zeasDxPosQ0GqiMCZVtz97NrODEp36WiJ7sAT0X0R-B26KjBqY Jul 21 20:18:23.425831 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Domain-Id: None Jul 21 20:18:23.425831 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Domain-Name: None Jul 21 20:18:23.425831 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Identity-Status: Confirmed Jul 21 20:18:23.425831 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Is-Admin-Project: True Jul 21 20:18:23.425831 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Id: default Jul 21 20:18:23.425831 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Name: Default Jul 21 20:18:23.425831 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Id: 997a259cf4b240fba9b065a43b2ed4fc Jul 21 20:18:23.425831 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Name: tempest-TestVolumeBootPattern-647171023 Jul 21 20:18:23.425831 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Role: reader,member Jul 21 20:18:23.425831 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Roles: reader,member Jul 21 20:18:23.427543 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/997a259cf4b240fba9b065a43b2ed4fc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/997a259cf4b240fba9b065a43b2ed4fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_997a259cf4b240fba9b065a43b2ed4fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/997a259cf4b240fba9b065a43b2ed4fc"}]}] Jul 21 20:18:23.427543 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Tenant: tempest-TestVolumeBootPattern-647171023 Jul 21 20:18:23.427543 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Tenant-Id: 997a259cf4b240fba9b065a43b2ed4fc Jul 21 20:18:23.427543 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Tenant-Name: tempest-TestVolumeBootPattern-647171023 Jul 21 20:18:23.427543 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User: tempest-TestVolumeBootPattern-647171023-project Jul 21 20:18:23.427543 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Id: default Jul 21 20:18:23.427543 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Name: Default Jul 21 20:18:23.427543 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Id: c4460571d9294e38931274a55c6c5857 Jul 21 20:18:23.427543 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Name: tempest-TestVolumeBootPattern-647171023-project Jul 21 20:18:23.427543 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: method: > Jul 21 20:18:23.427543 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: exception: Instance 80714390-c8b6-4703-a02a-d41fafad3540 could not be found. Jul 21 20:18:23.427543 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: action_args: {'id': '80714390-c8b6-4703-a02a-d41fafad3540'} Jul 21 20:18:23.428426 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 20:18:23.428426 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:18:23.428426 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 20:18:23.428426 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 20:18:23.428426 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 20:18:23.428426 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 20:18:23.428426 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 20:18:23.428426 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 20:18:23.428426 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 20:18:23.428426 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 20:18:23.428426 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80714390-c8b6-4703-a02a-d41fafad3540 could not be found. Jul 21 20:18:23.428426 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:18:23.428426 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:18:23.428426 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:18:23.428426 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:18:23.428426 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:18:23.428426 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:18:23.428426 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 20:18:23.428426 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 20:18:23.428426 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 20:18:23.429974 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 20:18:23.429974 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 20:18:23.429974 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 20:18:23.429974 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 20:18:23.429974 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 20:18:23.429974 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 20:18:23.429974 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 20:18:23.429974 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80714390-c8b6-4703-a02a-d41fafad3540 could not be found. Jul 21 20:18:23.429974 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:18:23.429974 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:18:23.429974 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:18:23.429974 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:18:23.429974 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:18:23.429974 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:18:23.429974 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 20:18:23.429974 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 20:18:23.429974 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80714390-c8b6-4703-a02a-d41fafad3540 could not be found. Jul 21 20:18:23.429974 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:18:23.431936 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-f6323e98-51d3-4e2f-9deb-28e76cdd9843 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Returning 404 to user: Instance 80714390-c8b6-4703-a02a-d41fafad3540 could not be found. {{(pid=118345) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 20:18:23.431936 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-f6323e98-51d3-4e2f-9deb-28e76cdd9843 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] 10.222.0.58 "GET /compute/v2.1/servers/80714390-c8b6-4703-a02a-d41fafad3540" status: 404 len: 111 microversion: 2.1 time: 0.033872 Jul 21 20:18:23.432625 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 568/1118] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:18:23 2022] GET /compute/v2.1/servers/80714390-c8b6-4703-a02a-d41fafad3540 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 21 20:18:23.535679 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-b5cfea2e-3d39-4277-b51e-d0b21f9def64 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-84490125", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1032901572", "security_groups": [{"name": "tempest-secgroup-smoke-1994785573"}], "block_device_mapping_v2": [{"uuid": "263a01fb-c70f-40eb-8320-e4cc3c6140f4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6458e3c6-6a10-4dd1-8440-3ff5b4539889"}]}} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:18:23.657894 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.network.neutron [None req-b5cfea2e-3d39-4277-b51e-d0b21f9def64 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] validate_networks() for [('6458e3c6-6a10-4dd1-8440-3ff5b4539889', None, None, None, None, None)] {{(pid=118345) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 20:18:23.727002 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-f3c6602a-f721-4bfd-8ab6-d03005c21fd3 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216eb0b454534a878c30a23e9126ff9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c262cd918784d6490dcd78eda61c551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:18:23.731124 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-f3c6602a-f721-4bfd-8ab6-d03005c21fd3 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] 10.222.0.58 "GET /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682" status: 200 len: 1358 microversion: 2.1 time: 0.484674 Jul 21 20:18:23.731691 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 551/1119] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:18:23 2022] GET /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682 => generated 1358 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:18:24.032733 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-b5cfea2e-3d39-4277-b51e-d0b21f9def64 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Flavor limits 0:0:0 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 20:18:24.033158 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-b5cfea2e-3d39-4277-b51e-d0b21f9def64 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Image limits 0:0:0 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 20:18:24.033665 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-b5cfea2e-3d39-4277-b51e-d0b21f9def64 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Flavor pref 0:0:0 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 20:18:24.034071 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-b5cfea2e-3d39-4277-b51e-d0b21f9def64 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Image pref 0:0:0 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 20:18:24.034482 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-b5cfea2e-3d39-4277-b51e-d0b21f9def64 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 20:18:24.043797 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b5cfea2e-3d39-4277-b51e-d0b21f9def64 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:24.044243 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b5cfea2e-3d39-4277-b51e-d0b21f9def64 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:24.045049 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b5cfea2e-3d39-4277-b51e-d0b21f9def64 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:24.045662 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b5cfea2e-3d39-4277-b51e-d0b21f9def64 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:24.051886 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-c32c7074-88a4-481f-baa4-16c16cc24630 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:18:24.053067 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-c32c7074-88a4-481f-baa4-16c16cc24630 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] [instance: 6088dba0-f178-48c2-8fed-1e0c93d88aed] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:18:24.059825 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-c32c7074-88a4-481f-baa4-16c16cc24630 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:24.060278 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-c32c7074-88a4-481f-baa4-16c16cc24630 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:24.061048 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-c32c7074-88a4-481f-baa4-16c16cc24630 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:24.061609 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-c32c7074-88a4-481f-baa4-16c16cc24630 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:24.063115 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.quota [None req-b5cfea2e-3d39-4277-b51e-d0b21f9def64 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Getting quotas for project 997a259cf4b240fba9b065a43b2ed4fc. Resources: {'instances', 'cores', 'ram'} {{(pid=118345) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 20:18:24.067135 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.quota [None req-b5cfea2e-3d39-4277-b51e-d0b21f9def64 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Getting quotas for user c4460571d9294e38931274a55c6c5857 and project 997a259cf4b240fba9b065a43b2ed4fc. Resources: {'instances', 'cores', 'ram'} {{(pid=118345) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 20:18:24.130167 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-b5cfea2e-3d39-4277-b51e-d0b21f9def64 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Going to run 1 instances... {{(pid=118345) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 20:18:24.132387 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-b5cfea2e-3d39-4277-b51e-d0b21f9def64 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] [instance: 15930e99-4a7e-48c9-be0d-5b3d91fb044c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='263a01fb-c70f-40eb-8320-e4cc3c6140f4',volume_size=None,volume_type=None)] {{(pid=118345) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 20:18:24.241275 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-c32c7074-88a4-481f-baa4-16c16cc24630 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f41baf9558b04546aaa5bf112e4c4fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9872332c8270445f9feacb0d76982f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:18:24.248903 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-c32c7074-88a4-481f-baa4-16c16cc24630 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] 10.222.0.58 "GET /compute/v2.1/servers/6088dba0-f178-48c2-8fed-1e0c93d88aed" status: 200 len: 1314 microversion: 2.1 time: 0.201099 Jul 21 20:18:24.249464 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 552/1120] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:18:24 2022] GET /compute/v2.1/servers/6088dba0-f178-48c2-8fed-1e0c93d88aed => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:18:24.611793 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-b5cfea2e-3d39-4277-b51e-d0b21f9def64 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.080015 Jul 21 20:18:24.612421 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 569/1121] 10.222.0.58 () {60 vars in 1146 bytes} [Thu Jul 21 20:18:23 2022] POST /compute/v2.1/servers => generated 406 bytes in 1081 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 21 20:18:24.622610 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-902fb90c-6795-4b90-8122-d8165d3023b7 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:18:24.623256 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-902fb90c-6795-4b90-8122-d8165d3023b7 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] [instance: 15930e99-4a7e-48c9-be0d-5b3d91fb044c] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:18:24.677978 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-902fb90c-6795-4b90-8122-d8165d3023b7 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4460571d9294e38931274a55c6c5857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a259cf4b240fba9b065a43b2ed4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:18:24.684831 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-902fb90c-6795-4b90-8122-d8165d3023b7 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] 10.222.0.58 "GET /compute/v2.1/servers/15930e99-4a7e-48c9-be0d-5b3d91fb044c" status: 200 len: 1093 microversion: 2.1 time: 0.066241 Jul 21 20:18:24.685574 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 553/1122] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:18:24 2022] GET /compute/v2.1/servers/15930e99-4a7e-48c9-be0d-5b3d91fb044c => generated 1093 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:18:24.747446 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-c4bdea7c-f9c2-4092-9e17-ebfb143326e1 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:18:24.748074 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-c4bdea7c-f9c2-4092-9e17-ebfb143326e1 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] [instance: 25c00062-b8e5-4575-a993-bcace67b3682] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:18:24.751371 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:18:24.754945 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c4bdea7c-f9c2-4092-9e17-ebfb143326e1 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:24.755421 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c4bdea7c-f9c2-4092-9e17-ebfb143326e1 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:24.756674 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c4bdea7c-f9c2-4092-9e17-ebfb143326e1 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:24.757053 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c4bdea7c-f9c2-4092-9e17-ebfb143326e1 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:24.892780 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-c4bdea7c-f9c2-4092-9e17-ebfb143326e1 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216eb0b454534a878c30a23e9126ff9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c262cd918784d6490dcd78eda61c551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:18:24.900888 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-c4bdea7c-f9c2-4092-9e17-ebfb143326e1 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] 10.222.0.58 "GET /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682" status: 200 len: 1358 microversion: 2.1 time: 0.157687 Jul 21 20:18:24.901456 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 570/1123] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:18:24 2022] GET /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:18:25.009651 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [req-806956e9-a094-40c4-a67b-8f4a1bc9806d req-798ddf7a-a029-4110-b510-d3449cf1707c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25c00062-b8e5-4575-a993-bcace67b3682", "name": "network-vif-plugged", "status": "completed", "tag": "eae9dff4-a338-4cab-b3de-c05350da7fab"}]} {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:18:25.020578 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [req-806956e9-a094-40c4-a67b-8f4a1bc9806d req-798ddf7a-a029-4110-b510-d3449cf1707c service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:25.021014 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [req-806956e9-a094-40c4-a67b-8f4a1bc9806d req-798ddf7a-a029-4110-b510-d3449cf1707c service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:25.034308 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.compute.server_external_events [req-806956e9-a094-40c4-a67b-8f4a1bc9806d req-798ddf7a-a029-4110-b510-d3449cf1707c service nova] Creating event network-vif-plugged:eae9dff4-a338-4cab-b3de-c05350da7fab for instance 25c00062-b8e5-4575-a993-bcace67b3682 on hv-cinder-85054 Jul 21 20:18:25.039582 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [req-806956e9-a094-40c4-a67b-8f4a1bc9806d req-798ddf7a-a029-4110-b510-d3449cf1707c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034302 Jul 21 20:18:25.040181 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 554/1124] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 20:18:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:18:25.266179 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-cfedf20f-517d-4014-bd59-037df9902713 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:18:25.266714 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-cfedf20f-517d-4014-bd59-037df9902713 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] [instance: 6088dba0-f178-48c2-8fed-1e0c93d88aed] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:18:25.273178 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-cfedf20f-517d-4014-bd59-037df9902713 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:25.273618 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-cfedf20f-517d-4014-bd59-037df9902713 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:25.274409 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-cfedf20f-517d-4014-bd59-037df9902713 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:25.274844 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-cfedf20f-517d-4014-bd59-037df9902713 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:25.408505 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-cfedf20f-517d-4014-bd59-037df9902713 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f41baf9558b04546aaa5bf112e4c4fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9872332c8270445f9feacb0d76982f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:18:25.416550 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-cfedf20f-517d-4014-bd59-037df9902713 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] 10.222.0.58 "GET /compute/v2.1/servers/6088dba0-f178-48c2-8fed-1e0c93d88aed" status: 200 len: 1314 microversion: 2.1 time: 0.154440 Jul 21 20:18:25.417109 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 571/1125] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:18:25 2022] GET /compute/v2.1/servers/6088dba0-f178-48c2-8fed-1e0c93d88aed => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:18:25.702245 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-cb686d43-d6b5-4227-84a2-0f38be084ac9 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:18:25.702930 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-cb686d43-d6b5-4227-84a2-0f38be084ac9 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] [instance: 15930e99-4a7e-48c9-be0d-5b3d91fb044c] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:18:25.709100 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-cb686d43-d6b5-4227-84a2-0f38be084ac9 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:25.709536 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-cb686d43-d6b5-4227-84a2-0f38be084ac9 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:25.710283 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-cb686d43-d6b5-4227-84a2-0f38be084ac9 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:25.710711 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-cb686d43-d6b5-4227-84a2-0f38be084ac9 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:25.771166 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-cb686d43-d6b5-4227-84a2-0f38be084ac9 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4460571d9294e38931274a55c6c5857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a259cf4b240fba9b065a43b2ed4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:18:25.779084 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-cb686d43-d6b5-4227-84a2-0f38be084ac9 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] 10.222.0.58 "GET /compute/v2.1/servers/15930e99-4a7e-48c9-be0d-5b3d91fb044c" status: 200 len: 1143 microversion: 2.1 time: 0.081435 Jul 21 20:18:25.779654 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 555/1126] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:18:25 2022] GET /compute/v2.1/servers/15930e99-4a7e-48c9-be0d-5b3d91fb044c => generated 1143 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:18:25.918165 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-3139bd42-d6c6-4c75-ae16-58793fe20efc tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:18:25.918772 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-3139bd42-d6c6-4c75-ae16-58793fe20efc tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] [instance: 25c00062-b8e5-4575-a993-bcace67b3682] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:18:25.924756 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3139bd42-d6c6-4c75-ae16-58793fe20efc tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:25.925198 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3139bd42-d6c6-4c75-ae16-58793fe20efc tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:25.925954 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3139bd42-d6c6-4c75-ae16-58793fe20efc tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:25.926382 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3139bd42-d6c6-4c75-ae16-58793fe20efc tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:26.051706 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-3139bd42-d6c6-4c75-ae16-58793fe20efc tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216eb0b454534a878c30a23e9126ff9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c262cd918784d6490dcd78eda61c551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:18:26.058987 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-3139bd42-d6c6-4c75-ae16-58793fe20efc tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] 10.222.0.58 "GET /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682" status: 200 len: 1358 microversion: 2.1 time: 0.145241 Jul 21 20:18:26.059580 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 572/1127] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:18:25 2022] GET /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682 => generated 1358 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:18:26.434552 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-b97f9b5e-a690-40f7-8501-72fa43b80a2b tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:18:26.435193 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-b97f9b5e-a690-40f7-8501-72fa43b80a2b tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] [instance: 6088dba0-f178-48c2-8fed-1e0c93d88aed] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:18:26.441874 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-b97f9b5e-a690-40f7-8501-72fa43b80a2b tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:26.442695 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-b97f9b5e-a690-40f7-8501-72fa43b80a2b tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:26.443530 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-b97f9b5e-a690-40f7-8501-72fa43b80a2b tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:26.445979 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-b97f9b5e-a690-40f7-8501-72fa43b80a2b tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:26.581122 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-b97f9b5e-a690-40f7-8501-72fa43b80a2b tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f41baf9558b04546aaa5bf112e4c4fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9872332c8270445f9feacb0d76982f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:18:26.588536 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-b97f9b5e-a690-40f7-8501-72fa43b80a2b tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] 10.222.0.58 "GET /compute/v2.1/servers/6088dba0-f178-48c2-8fed-1e0c93d88aed" status: 200 len: 1314 microversion: 2.1 time: 0.158718 Jul 21 20:18:26.589116 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 556/1128] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:18:26 2022] GET /compute/v2.1/servers/6088dba0-f178-48c2-8fed-1e0c93d88aed => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:18:26.796173 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-12551113-9658-4014-b2e8-d434a331684a tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:18:26.796798 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-12551113-9658-4014-b2e8-d434a331684a tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] [instance: 15930e99-4a7e-48c9-be0d-5b3d91fb044c] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:18:26.803361 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-12551113-9658-4014-b2e8-d434a331684a tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:26.803811 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-12551113-9658-4014-b2e8-d434a331684a tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:26.804590 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-12551113-9658-4014-b2e8-d434a331684a tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:26.805019 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-12551113-9658-4014-b2e8-d434a331684a tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:26.869312 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-12551113-9658-4014-b2e8-d434a331684a tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4460571d9294e38931274a55c6c5857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a259cf4b240fba9b065a43b2ed4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:18:26.883445 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-12551113-9658-4014-b2e8-d434a331684a tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] 10.222.0.58 "GET /compute/v2.1/servers/15930e99-4a7e-48c9-be0d-5b3d91fb044c" status: 200 len: 1191 microversion: 2.1 time: 0.091244 Jul 21 20:18:26.884261 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 573/1129] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:18:26 2022] GET /compute/v2.1/servers/15930e99-4a7e-48c9-be0d-5b3d91fb044c => generated 1191 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:18:27.075628 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-0377d8fa-1ee7-4042-9e49-79d3859a49e4 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:18:27.076250 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-0377d8fa-1ee7-4042-9e49-79d3859a49e4 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] [instance: 25c00062-b8e5-4575-a993-bcace67b3682] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:18:27.082829 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-0377d8fa-1ee7-4042-9e49-79d3859a49e4 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:27.083315 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-0377d8fa-1ee7-4042-9e49-79d3859a49e4 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:27.084090 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-0377d8fa-1ee7-4042-9e49-79d3859a49e4 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:27.084529 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-0377d8fa-1ee7-4042-9e49-79d3859a49e4 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:27.216397 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-0377d8fa-1ee7-4042-9e49-79d3859a49e4 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216eb0b454534a878c30a23e9126ff9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c262cd918784d6490dcd78eda61c551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:18:27.224183 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-0377d8fa-1ee7-4042-9e49-79d3859a49e4 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] 10.222.0.58 "GET /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682" status: 200 len: 1358 microversion: 2.1 time: 0.152709 Jul 21 20:18:27.224746 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 557/1130] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:18:27 2022] GET /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:18:27.605723 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-66594743-607e-4934-a346-12966d68a580 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:18:27.606329 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-66594743-607e-4934-a346-12966d68a580 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] [instance: 6088dba0-f178-48c2-8fed-1e0c93d88aed] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:18:27.612352 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-66594743-607e-4934-a346-12966d68a580 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:27.612735 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-66594743-607e-4934-a346-12966d68a580 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:27.613498 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-66594743-607e-4934-a346-12966d68a580 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:27.613932 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-66594743-607e-4934-a346-12966d68a580 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:27.745348 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-66594743-607e-4934-a346-12966d68a580 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f41baf9558b04546aaa5bf112e4c4fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9872332c8270445f9feacb0d76982f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:18:27.752678 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-66594743-607e-4934-a346-12966d68a580 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] 10.222.0.58 "GET /compute/v2.1/servers/6088dba0-f178-48c2-8fed-1e0c93d88aed" status: 200 len: 1314 microversion: 2.1 time: 0.150912 Jul 21 20:18:27.753238 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 574/1131] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:18:27 2022] GET /compute/v2.1/servers/6088dba0-f178-48c2-8fed-1e0c93d88aed => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:18:27.901133 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-8dc6b290-98ea-4742-bde9-3858d39c1be6 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:18:27.901747 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-8dc6b290-98ea-4742-bde9-3858d39c1be6 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] [instance: 15930e99-4a7e-48c9-be0d-5b3d91fb044c] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:18:27.908157 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-8dc6b290-98ea-4742-bde9-3858d39c1be6 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:27.908743 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-8dc6b290-98ea-4742-bde9-3858d39c1be6 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:27.909552 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-8dc6b290-98ea-4742-bde9-3858d39c1be6 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:27.909985 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-8dc6b290-98ea-4742-bde9-3858d39c1be6 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:27.971758 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-8dc6b290-98ea-4742-bde9-3858d39c1be6 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4460571d9294e38931274a55c6c5857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a259cf4b240fba9b065a43b2ed4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:18:27.979087 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-8dc6b290-98ea-4742-bde9-3858d39c1be6 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] 10.222.0.58 "GET /compute/v2.1/servers/15930e99-4a7e-48c9-be0d-5b3d91fb044c" status: 200 len: 1191 microversion: 2.1 time: 0.082428 Jul 21 20:18:27.979657 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 558/1132] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:18:27 2022] GET /compute/v2.1/servers/15930e99-4a7e-48c9-be0d-5b3d91fb044c => generated 1191 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:18:28.241509 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-563b9606-d6a7-4caa-9fc1-c429d306403f tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:18:28.242033 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-563b9606-d6a7-4caa-9fc1-c429d306403f tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] [instance: 25c00062-b8e5-4575-a993-bcace67b3682] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:18:28.249221 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-563b9606-d6a7-4caa-9fc1-c429d306403f tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:28.249648 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-563b9606-d6a7-4caa-9fc1-c429d306403f tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:28.250413 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-563b9606-d6a7-4caa-9fc1-c429d306403f tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:28.250876 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-563b9606-d6a7-4caa-9fc1-c429d306403f tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:28.378361 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-563b9606-d6a7-4caa-9fc1-c429d306403f tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216eb0b454534a878c30a23e9126ff9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c262cd918784d6490dcd78eda61c551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:18:28.385703 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-563b9606-d6a7-4caa-9fc1-c429d306403f tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] 10.222.0.58 "GET /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682" status: 200 len: 1548 microversion: 2.1 time: 0.148149 Jul 21 20:18:28.386261 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 575/1133] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:18:28 2022] GET /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682 => generated 1548 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:18:28.401983 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-1b8bb28e-65cc-4420-a223-4f00c6c1fde1 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:18:28.402586 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-1b8bb28e-65cc-4420-a223-4f00c6c1fde1 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] [instance: 25c00062-b8e5-4575-a993-bcace67b3682] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:18:28.409026 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-1b8bb28e-65cc-4420-a223-4f00c6c1fde1 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:28.409482 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-1b8bb28e-65cc-4420-a223-4f00c6c1fde1 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:28.410214 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-1b8bb28e-65cc-4420-a223-4f00c6c1fde1 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:28.410640 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-1b8bb28e-65cc-4420-a223-4f00c6c1fde1 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:28.630068 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-1b8bb28e-65cc-4420-a223-4f00c6c1fde1 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216eb0b454534a878c30a23e9126ff9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c262cd918784d6490dcd78eda61c551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:18:28.632414 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG dbcounter [-] [118344] Writing DB stats nova_cell1:SELECT=100 {{(pid=118344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:18:28.638456 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-1b8bb28e-65cc-4420-a223-4f00c6c1fde1 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] 10.222.0.58 "GET /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682" status: 200 len: 1548 microversion: 2.1 time: 0.240442 Jul 21 20:18:28.639046 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 559/1134] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:18:28 2022] GET /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682 => generated 1548 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:18:28.654015 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-e2e3a179-62d0-4ef3-986e-1c7a67014544 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:18:28.657514 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-e2e3a179-62d0-4ef3-986e-1c7a67014544 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '216eb0b454534a878c30a23e9126ff9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c262cd918784d6490dcd78eda61c551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:18:28.658280 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-e2e3a179-62d0-4ef3-986e-1c7a67014544 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Searching by: {'deleted': False, 'project_id': '3c262cd918784d6490dcd78eda61c551'} {{(pid=118345) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 21 20:18:28.664849 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e2e3a179-62d0-4ef3-986e-1c7a67014544 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:28.665794 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e2e3a179-62d0-4ef3-986e-1c7a67014544 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:28.666585 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e2e3a179-62d0-4ef3-986e-1c7a67014544 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:28.667064 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e2e3a179-62d0-4ef3-986e-1c7a67014544 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:28.764673 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.multi_cell_list [None req-e2e3a179-62d0-4ef3-986e-1c7a67014544 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118345) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 21 20:18:28.777482 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-95dfd1ae-1463-4123-b364-3e8ef7e3dd9c tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:18:28.778218 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-95dfd1ae-1463-4123-b364-3e8ef7e3dd9c tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] [instance: 6088dba0-f178-48c2-8fed-1e0c93d88aed] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:18:28.785092 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-95dfd1ae-1463-4123-b364-3e8ef7e3dd9c tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:28.785849 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-95dfd1ae-1463-4123-b364-3e8ef7e3dd9c tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:28.786889 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-95dfd1ae-1463-4123-b364-3e8ef7e3dd9c tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:28.787566 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-95dfd1ae-1463-4123-b364-3e8ef7e3dd9c tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:28.890676 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-e2e3a179-62d0-4ef3-986e-1c7a67014544 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] 10.222.0.58 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.240445 Jul 21 20:18:28.891310 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 576/1135] 10.222.0.58 () {58 vars in 1124 bytes} [Thu Jul 21 20:18:28 2022] GET /compute/v2.1/servers => generated 343 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:18:28.902080 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-4b968932-71a0-4f40-a1aa-894c1729a3b5 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:18:28.902739 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-4b968932-71a0-4f40-a1aa-894c1729a3b5 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] [instance: 25c00062-b8e5-4575-a993-bcace67b3682] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:18:28.908870 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4b968932-71a0-4f40-a1aa-894c1729a3b5 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:28.915749 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4b968932-71a0-4f40-a1aa-894c1729a3b5 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:28.915749 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4b968932-71a0-4f40-a1aa-894c1729a3b5 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:28.915749 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4b968932-71a0-4f40-a1aa-894c1729a3b5 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:28.948970 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-95dfd1ae-1463-4123-b364-3e8ef7e3dd9c tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f41baf9558b04546aaa5bf112e4c4fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9872332c8270445f9feacb0d76982f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:18:28.959134 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-95dfd1ae-1463-4123-b364-3e8ef7e3dd9c tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] 10.222.0.58 "GET /compute/v2.1/servers/6088dba0-f178-48c2-8fed-1e0c93d88aed" status: 200 len: 1314 microversion: 2.1 time: 0.190296 Jul 21 20:18:28.960216 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 560/1136] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:18:28 2022] GET /compute/v2.1/servers/6088dba0-f178-48c2-8fed-1e0c93d88aed => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:18:28.997199 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-d6a7afa4-c083-45e1-a4e8-17dbe00dbe5b tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:18:28.997806 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-d6a7afa4-c083-45e1-a4e8-17dbe00dbe5b tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] [instance: 15930e99-4a7e-48c9-be0d-5b3d91fb044c] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:18:29.003525 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG dbcounter [-] [118344] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=118344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:18:29.007298 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-d6a7afa4-c083-45e1-a4e8-17dbe00dbe5b tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:29.007298 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-d6a7afa4-c083-45e1-a4e8-17dbe00dbe5b tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:29.007298 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-d6a7afa4-c083-45e1-a4e8-17dbe00dbe5b tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:29.007631 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-d6a7afa4-c083-45e1-a4e8-17dbe00dbe5b tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:29.057530 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-4b968932-71a0-4f40-a1aa-894c1729a3b5 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216eb0b454534a878c30a23e9126ff9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c262cd918784d6490dcd78eda61c551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:18:29.066688 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-4b968932-71a0-4f40-a1aa-894c1729a3b5 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] 10.222.0.58 "GET /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682" status: 200 len: 1548 microversion: 2.1 time: 0.169024 Jul 21 20:18:29.075071 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 577/1137] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:18:28 2022] GET /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682 => generated 1548 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:18:29.097945 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [req-21fc2ed4-3ff1-4ee1-8c9e-acc738b3ce0c req-29913bf6-6939-4a3b-9599-d2fa67e7d483 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6088dba0-f178-48c2-8fed-1e0c93d88aed", "name": "network-vif-plugged", "status": "completed", "tag": "314e87d8-22d0-4600-adfe-f451a20d6dff"}]} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:18:29.107905 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-21fc2ed4-3ff1-4ee1-8c9e-acc738b3ce0c req-29913bf6-6939-4a3b-9599-d2fa67e7d483 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:29.108367 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-21fc2ed4-3ff1-4ee1-8c9e-acc738b3ce0c req-29913bf6-6939-4a3b-9599-d2fa67e7d483 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:29.119583 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.compute.server_external_events [req-21fc2ed4-3ff1-4ee1-8c9e-acc738b3ce0c req-29913bf6-6939-4a3b-9599-d2fa67e7d483 service nova] Creating event network-vif-plugged:314e87d8-22d0-4600-adfe-f451a20d6dff for instance 6088dba0-f178-48c2-8fed-1e0c93d88aed on hv-cinder-85054 Jul 21 20:18:29.121678 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-d6a7afa4-c083-45e1-a4e8-17dbe00dbe5b tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4460571d9294e38931274a55c6c5857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a259cf4b240fba9b065a43b2ed4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:18:29.125159 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [req-21fc2ed4-3ff1-4ee1-8c9e-acc738b3ce0c req-29913bf6-6939-4a3b-9599-d2fa67e7d483 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031157 Jul 21 20:18:29.126029 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 578/1138] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 20:18:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 20:18:29.137969 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-d6a7afa4-c083-45e1-a4e8-17dbe00dbe5b tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] 10.222.0.58 "GET /compute/v2.1/servers/15930e99-4a7e-48c9-be0d-5b3d91fb044c" status: 200 len: 1209 microversion: 2.1 time: 0.140290 Jul 21 20:18:29.137969 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 561/1139] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:18:28 2022] GET /compute/v2.1/servers/15930e99-4a7e-48c9-be0d-5b3d91fb044c => generated 1209 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:18:29.979183 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-34badd85-e58e-4215-8aa2-822fba2fe823 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:18:29.980465 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-34badd85-e58e-4215-8aa2-822fba2fe823 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] [instance: 6088dba0-f178-48c2-8fed-1e0c93d88aed] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:18:29.986946 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-34badd85-e58e-4215-8aa2-822fba2fe823 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:29.987442 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-34badd85-e58e-4215-8aa2-822fba2fe823 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:29.988216 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-34badd85-e58e-4215-8aa2-822fba2fe823 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:29.988653 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-34badd85-e58e-4215-8aa2-822fba2fe823 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:30.126481 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-34badd85-e58e-4215-8aa2-822fba2fe823 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f41baf9558b04546aaa5bf112e4c4fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9872332c8270445f9feacb0d76982f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:18:30.138154 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-34badd85-e58e-4215-8aa2-822fba2fe823 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] 10.222.0.58 "GET /compute/v2.1/servers/6088dba0-f178-48c2-8fed-1e0c93d88aed" status: 200 len: 1314 microversion: 2.1 time: 0.164337 Jul 21 20:18:30.138769 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 579/1140] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:18:29 2022] GET /compute/v2.1/servers/6088dba0-f178-48c2-8fed-1e0c93d88aed => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:18:30.155179 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-f250f095-36fa-4502-90bc-d51c76a6e941 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:18:30.156485 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-f250f095-36fa-4502-90bc-d51c76a6e941 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] [instance: 15930e99-4a7e-48c9-be0d-5b3d91fb044c] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:18:30.163851 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f250f095-36fa-4502-90bc-d51c76a6e941 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:30.164550 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f250f095-36fa-4502-90bc-d51c76a6e941 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:30.169704 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f250f095-36fa-4502-90bc-d51c76a6e941 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:30.169704 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f250f095-36fa-4502-90bc-d51c76a6e941 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:30.375517 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-f250f095-36fa-4502-90bc-d51c76a6e941 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4460571d9294e38931274a55c6c5857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a259cf4b240fba9b065a43b2ed4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:18:30.382789 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-f250f095-36fa-4502-90bc-d51c76a6e941 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] 10.222.0.58 "GET /compute/v2.1/servers/15930e99-4a7e-48c9-be0d-5b3d91fb044c" status: 200 len: 1277 microversion: 2.1 time: 0.231843 Jul 21 20:18:30.383405 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 562/1141] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:18:30 2022] GET /compute/v2.1/servers/15930e99-4a7e-48c9-be0d-5b3d91fb044c => generated 1277 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:18:30.482526 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [req-7258de23-1ae0-46b5-903a-faee7cb6288e req-733771d1-b846-4ceb-a055-6373e884c20a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15930e99-4a7e-48c9-be0d-5b3d91fb044c", "tag": "fc62afdf-aa2c-456a-b4bd-d7f4981ec4d3"}]} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:18:30.490651 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-7258de23-1ae0-46b5-903a-faee7cb6288e req-733771d1-b846-4ceb-a055-6373e884c20a service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:30.491119 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-7258de23-1ae0-46b5-903a-faee7cb6288e req-733771d1-b846-4ceb-a055-6373e884c20a service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:30.503638 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.compute.server_external_events [req-7258de23-1ae0-46b5-903a-faee7cb6288e req-733771d1-b846-4ceb-a055-6373e884c20a service nova] Creating event network-changed:fc62afdf-aa2c-456a-b4bd-d7f4981ec4d3 for instance 15930e99-4a7e-48c9-be0d-5b3d91fb044c on hv-cinder-85054 Jul 21 20:18:30.508291 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [req-7258de23-1ae0-46b5-903a-faee7cb6288e req-733771d1-b846-4ceb-a055-6373e884c20a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030478 Jul 21 20:18:30.509474 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 580/1142] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 20:18:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:18:31.051322 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-7bd7bf11-bc5c-4e1b-ac96-9f94297ab500 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ebabd94a-760a-4408-b95d-719ad87a4103"}} {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:18:31.052392 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-7bd7bf11-bc5c-4e1b-ac96-9f94297ab500 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] [instance: 25c00062-b8e5-4575-a993-bcace67b3682] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:18:31.058558 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-7bd7bf11-bc5c-4e1b-ac96-9f94297ab500 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:31.059009 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-7bd7bf11-bc5c-4e1b-ac96-9f94297ab500 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:31.059832 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-7bd7bf11-bc5c-4e1b-ac96-9f94297ab500 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:31.060265 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-7bd7bf11-bc5c-4e1b-ac96-9f94297ab500 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:31.155733 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-39523181-c3fc-4636-856a-014c1acac595 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:18:31.156422 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-39523181-c3fc-4636-856a-014c1acac595 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] [instance: 6088dba0-f178-48c2-8fed-1e0c93d88aed] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:18:31.163141 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-39523181-c3fc-4636-856a-014c1acac595 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:31.163604 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-39523181-c3fc-4636-856a-014c1acac595 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:31.164326 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-39523181-c3fc-4636-856a-014c1acac595 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:31.164755 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-39523181-c3fc-4636-856a-014c1acac595 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:31.292925 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-39523181-c3fc-4636-856a-014c1acac595 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f41baf9558b04546aaa5bf112e4c4fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9872332c8270445f9feacb0d76982f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:18:31.300250 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-39523181-c3fc-4636-856a-014c1acac595 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] 10.222.0.58 "GET /compute/v2.1/servers/6088dba0-f178-48c2-8fed-1e0c93d88aed" status: 200 len: 1314 microversion: 2.1 time: 0.148567 Jul 21 20:18:31.300814 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 581/1143] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:18:31 2022] GET /compute/v2.1/servers/6088dba0-f178-48c2-8fed-1e0c93d88aed => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:18:31.400393 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-30406d67-8dc9-4738-807f-59e3dffc1aa4 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:18:31.401008 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-30406d67-8dc9-4738-807f-59e3dffc1aa4 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] [instance: 15930e99-4a7e-48c9-be0d-5b3d91fb044c] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:18:31.406916 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-30406d67-8dc9-4738-807f-59e3dffc1aa4 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:31.407409 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-30406d67-8dc9-4738-807f-59e3dffc1aa4 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:31.408168 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-30406d67-8dc9-4738-807f-59e3dffc1aa4 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:31.408603 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-30406d67-8dc9-4738-807f-59e3dffc1aa4 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:31.412608 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell1:SELECT=100 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:18:31.544426 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-30406d67-8dc9-4738-807f-59e3dffc1aa4 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4460571d9294e38931274a55c6c5857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a259cf4b240fba9b065a43b2ed4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:18:31.552009 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-30406d67-8dc9-4738-807f-59e3dffc1aa4 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] 10.222.0.58 "GET /compute/v2.1/servers/15930e99-4a7e-48c9-be0d-5b3d91fb044c" status: 200 len: 1277 microversion: 2.1 time: 0.155459 Jul 21 20:18:31.552587 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 582/1144] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:18:31 2022] GET /compute/v2.1/servers/15930e99-4a7e-48c9-be0d-5b3d91fb044c => generated 1277 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:18:32.186103 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-7bd7bf11-bc5c-4e1b-ac96-9f94297ab500 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] 10.222.0.58 "POST /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.138652 Jul 21 20:18:32.186720 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 563/1145] 10.222.0.58 () {60 vars in 1322 bytes} [Thu Jul 21 20:18:31 2022] POST /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682/os-volume_attachments => generated 194 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:18:32.317480 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-0e20b97a-8af1-4be0-b193-c93902797837 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:18:32.318081 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-0e20b97a-8af1-4be0-b193-c93902797837 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] [instance: 6088dba0-f178-48c2-8fed-1e0c93d88aed] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:18:32.324604 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0e20b97a-8af1-4be0-b193-c93902797837 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:32.325045 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0e20b97a-8af1-4be0-b193-c93902797837 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:32.325796 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0e20b97a-8af1-4be0-b193-c93902797837 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:32.326219 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0e20b97a-8af1-4be0-b193-c93902797837 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:32.455843 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-0e20b97a-8af1-4be0-b193-c93902797837 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f41baf9558b04546aaa5bf112e4c4fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9872332c8270445f9feacb0d76982f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:18:32.463781 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-0e20b97a-8af1-4be0-b193-c93902797837 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] 10.222.0.58 "GET /compute/v2.1/servers/6088dba0-f178-48c2-8fed-1e0c93d88aed" status: 200 len: 1464 microversion: 2.1 time: 0.150150 Jul 21 20:18:32.464348 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 583/1146] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:18:32 2022] GET /compute/v2.1/servers/6088dba0-f178-48c2-8fed-1e0c93d88aed => generated 1464 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:18:32.503122 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-2d34ce7f-b488-4326-9bfe-49fd6d2ad2d8 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:18:32.503696 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-2d34ce7f-b488-4326-9bfe-49fd6d2ad2d8 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] [instance: 6088dba0-f178-48c2-8fed-1e0c93d88aed] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:18:32.509762 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-2d34ce7f-b488-4326-9bfe-49fd6d2ad2d8 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:32.510203 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-2d34ce7f-b488-4326-9bfe-49fd6d2ad2d8 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:32.510969 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-2d34ce7f-b488-4326-9bfe-49fd6d2ad2d8 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:32.511422 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-2d34ce7f-b488-4326-9bfe-49fd6d2ad2d8 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:32.535922 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-2d34ce7f-b488-4326-9bfe-49fd6d2ad2d8 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] [instance: 6088dba0-f178-48c2-8fed-1e0c93d88aed] Going to try to terminate instance {{(pid=118344) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 20:18:32.569552 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-f92ce8b3-bb26-4cc4-ad5e-3d566c15ce02 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:18:32.570268 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-f92ce8b3-bb26-4cc4-ad5e-3d566c15ce02 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] [instance: 15930e99-4a7e-48c9-be0d-5b3d91fb044c] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:18:32.576224 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f92ce8b3-bb26-4cc4-ad5e-3d566c15ce02 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:32.581387 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f92ce8b3-bb26-4cc4-ad5e-3d566c15ce02 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:32.581387 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f92ce8b3-bb26-4cc4-ad5e-3d566c15ce02 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:32.581387 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f92ce8b3-bb26-4cc4-ad5e-3d566c15ce02 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:32.710208 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-f92ce8b3-bb26-4cc4-ad5e-3d566c15ce02 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4460571d9294e38931274a55c6c5857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a259cf4b240fba9b065a43b2ed4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:18:32.718291 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-f92ce8b3-bb26-4cc4-ad5e-3d566c15ce02 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] 10.222.0.58 "GET /compute/v2.1/servers/15930e99-4a7e-48c9-be0d-5b3d91fb044c" status: 200 len: 1265 microversion: 2.1 time: 0.152508 Jul 21 20:18:32.719051 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 584/1147] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:18:32 2022] GET /compute/v2.1/servers/15930e99-4a7e-48c9-be0d-5b3d91fb044c => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:18:32.804308 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-2d34ce7f-b488-4326-9bfe-49fd6d2ad2d8 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] 10.222.0.58 "DELETE /compute/v2.1/servers/6088dba0-f178-48c2-8fed-1e0c93d88aed" status: 204 len: 0 microversion: 2.1 time: 0.305182 Jul 21 20:18:32.804895 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 564/1148] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Jul 21 20:18:32 2022] DELETE /compute/v2.1/servers/6088dba0-f178-48c2-8fed-1e0c93d88aed => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 20:18:32.812858 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-97de4530-1cdc-44a6-9f6f-6b5de721e21d tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:18:32.813482 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-97de4530-1cdc-44a6-9f6f-6b5de721e21d tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] [instance: 6088dba0-f178-48c2-8fed-1e0c93d88aed] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:18:32.819787 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-97de4530-1cdc-44a6-9f6f-6b5de721e21d tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:32.820230 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-97de4530-1cdc-44a6-9f6f-6b5de721e21d tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:32.820995 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-97de4530-1cdc-44a6-9f6f-6b5de721e21d tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:32.821986 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-97de4530-1cdc-44a6-9f6f-6b5de721e21d tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:32.956528 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-97de4530-1cdc-44a6-9f6f-6b5de721e21d tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f41baf9558b04546aaa5bf112e4c4fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9872332c8270445f9feacb0d76982f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:18:32.963993 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-97de4530-1cdc-44a6-9f6f-6b5de721e21d tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] 10.222.0.58 "GET /compute/v2.1/servers/6088dba0-f178-48c2-8fed-1e0c93d88aed" status: 200 len: 1470 microversion: 2.1 time: 0.154888 Jul 21 20:18:32.964553 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 585/1149] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:18:32 2022] GET /compute/v2.1/servers/6088dba0-f178-48c2-8fed-1e0c93d88aed => generated 1470 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:18:33.736507 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-3634e182-0556-4ea6-998a-7dad1d5528c3 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:18:33.737239 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-3634e182-0556-4ea6-998a-7dad1d5528c3 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] [instance: 15930e99-4a7e-48c9-be0d-5b3d91fb044c] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:18:33.743915 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-3634e182-0556-4ea6-998a-7dad1d5528c3 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:33.744367 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-3634e182-0556-4ea6-998a-7dad1d5528c3 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:33.745130 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-3634e182-0556-4ea6-998a-7dad1d5528c3 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:33.745566 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-3634e182-0556-4ea6-998a-7dad1d5528c3 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:33.879039 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-3634e182-0556-4ea6-998a-7dad1d5528c3 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4460571d9294e38931274a55c6c5857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a259cf4b240fba9b065a43b2ed4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:18:33.887733 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-3634e182-0556-4ea6-998a-7dad1d5528c3 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] 10.222.0.58 "GET /compute/v2.1/servers/15930e99-4a7e-48c9-be0d-5b3d91fb044c" status: 200 len: 1265 microversion: 2.1 time: 0.155510 Jul 21 20:18:33.888290 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 565/1150] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:18:33 2022] GET /compute/v2.1/servers/15930e99-4a7e-48c9-be0d-5b3d91fb044c => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:18:33.981875 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-a2953965-61b3-44d5-814d-ee40fa47457a tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:18:33.982484 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-a2953965-61b3-44d5-814d-ee40fa47457a tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] [instance: 6088dba0-f178-48c2-8fed-1e0c93d88aed] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:18:33.988930 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a2953965-61b3-44d5-814d-ee40fa47457a tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:33.989374 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a2953965-61b3-44d5-814d-ee40fa47457a tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:33.990131 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a2953965-61b3-44d5-814d-ee40fa47457a tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:33.990558 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a2953965-61b3-44d5-814d-ee40fa47457a tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:34.074407 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell0:SELECT=6 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:18:34.121538 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-a2953965-61b3-44d5-814d-ee40fa47457a tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f41baf9558b04546aaa5bf112e4c4fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9872332c8270445f9feacb0d76982f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:18:34.128799 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-a2953965-61b3-44d5-814d-ee40fa47457a tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] 10.222.0.58 "GET /compute/v2.1/servers/6088dba0-f178-48c2-8fed-1e0c93d88aed" status: 200 len: 1470 microversion: 2.1 time: 0.150772 Jul 21 20:18:34.129358 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 586/1151] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:18:33 2022] GET /compute/v2.1/servers/6088dba0-f178-48c2-8fed-1e0c93d88aed => generated 1470 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:18:34.904847 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-15d07871-4c3e-4406-be23-9f02f2d1121c tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:18:34.907864 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-15d07871-4c3e-4406-be23-9f02f2d1121c tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] [instance: 15930e99-4a7e-48c9-be0d-5b3d91fb044c] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:18:34.907864 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG dbcounter [-] [118344] Writing DB stats nova_cell0:SELECT=2 {{(pid=118344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:18:34.912899 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-15d07871-4c3e-4406-be23-9f02f2d1121c tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:34.913350 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-15d07871-4c3e-4406-be23-9f02f2d1121c tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:34.914116 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-15d07871-4c3e-4406-be23-9f02f2d1121c tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:34.914550 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-15d07871-4c3e-4406-be23-9f02f2d1121c tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:35.122618 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [req-369fba25-4f13-44c5-9c0b-7319a7c33b11 req-5d0e71ee-6b36-4dad-af79-8c148763f3dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6088dba0-f178-48c2-8fed-1e0c93d88aed", "name": "network-vif-deleted", "tag": "314e87d8-22d0-4600-adfe-f451a20d6dff"}]} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:18:35.125668 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-15d07871-4c3e-4406-be23-9f02f2d1121c tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4460571d9294e38931274a55c6c5857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a259cf4b240fba9b065a43b2ed4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:18:35.131667 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-369fba25-4f13-44c5-9c0b-7319a7c33b11 req-5d0e71ee-6b36-4dad-af79-8c148763f3dc service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:35.132111 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-369fba25-4f13-44c5-9c0b-7319a7c33b11 req-5d0e71ee-6b36-4dad-af79-8c148763f3dc service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:35.139282 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-15d07871-4c3e-4406-be23-9f02f2d1121c tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] 10.222.0.58 "GET /compute/v2.1/servers/15930e99-4a7e-48c9-be0d-5b3d91fb044c" status: 200 len: 1265 microversion: 2.1 time: 0.237748 Jul 21 20:18:35.139874 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 566/1152] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:18:34 2022] GET /compute/v2.1/servers/15930e99-4a7e-48c9-be0d-5b3d91fb044c => generated 1265 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:18:35.145860 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-01b71afb-fa93-499c-a36b-08491a2674b2 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:18:35.146603 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-01b71afb-fa93-499c-a36b-08491a2674b2 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] [instance: 6088dba0-f178-48c2-8fed-1e0c93d88aed] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:18:35.153892 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-01b71afb-fa93-499c-a36b-08491a2674b2 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:35.154334 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.compute.server_external_events [req-369fba25-4f13-44c5-9c0b-7319a7c33b11 req-5d0e71ee-6b36-4dad-af79-8c148763f3dc service nova] Creating event network-vif-deleted:314e87d8-22d0-4600-adfe-f451a20d6dff for instance 6088dba0-f178-48c2-8fed-1e0c93d88aed on hv-cinder-85054 Jul 21 20:18:35.154623 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-01b71afb-fa93-499c-a36b-08491a2674b2 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:35.160082 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-01b71afb-fa93-499c-a36b-08491a2674b2 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:35.160082 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-01b71afb-fa93-499c-a36b-08491a2674b2 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:35.160303 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [req-369fba25-4f13-44c5-9c0b-7319a7c33b11 req-5d0e71ee-6b36-4dad-af79-8c148763f3dc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041092 Jul 21 20:18:35.160797 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 587/1153] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 20:18:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 20:18:35.231135 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-01b71afb-fa93-499c-a36b-08491a2674b2 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f41baf9558b04546aaa5bf112e4c4fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9872332c8270445f9feacb0d76982f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:18:35.238944 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-01b71afb-fa93-499c-a36b-08491a2674b2 tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] 10.222.0.58 "GET /compute/v2.1/servers/6088dba0-f178-48c2-8fed-1e0c93d88aed" status: 200 len: 1428 microversion: 2.1 time: 0.096946 Jul 21 20:18:35.239552 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 567/1154] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:18:35 2022] GET /compute/v2.1/servers/6088dba0-f178-48c2-8fed-1e0c93d88aed => generated 1428 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:18:36.156837 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-030f446f-4ccd-4864-beca-cff18518f364 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:18:36.157557 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-030f446f-4ccd-4864-beca-cff18518f364 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] [instance: 15930e99-4a7e-48c9-be0d-5b3d91fb044c] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:18:36.164076 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-030f446f-4ccd-4864-beca-cff18518f364 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:36.164520 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-030f446f-4ccd-4864-beca-cff18518f364 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:36.165263 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-030f446f-4ccd-4864-beca-cff18518f364 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:36.166185 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-030f446f-4ccd-4864-beca-cff18518f364 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:36.255606 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-f3e79b7f-7300-4b6e-b244-4f1c7c49fffa tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:18:36.256223 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-f3e79b7f-7300-4b6e-b244-4f1c7c49fffa tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] [instance: 6088dba0-f178-48c2-8fed-1e0c93d88aed] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:18:36.262743 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f3e79b7f-7300-4b6e-b244-4f1c7c49fffa tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:36.263230 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f3e79b7f-7300-4b6e-b244-4f1c7c49fffa tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:36.264002 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f3e79b7f-7300-4b6e-b244-4f1c7c49fffa tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:36.264829 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f3e79b7f-7300-4b6e-b244-4f1c7c49fffa tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:36.280589 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.wsgi [None req-f3e79b7f-7300-4b6e-b244-4f1c7c49fffa tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] HTTP exception thrown: Instance 6088dba0-f178-48c2-8fed-1e0c93d88aed could not be found. Jul 21 20:18:36.282240 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-f3e79b7f-7300-4b6e-b244-4f1c7c49fffa tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Request method failure captured: Jul 21 20:18:36.282240 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: request: GET /compute/v2.1/servers/6088dba0-f178-48c2-8fed-1e0c93d88aed HTTP/1.1 Jul 21 20:18:36.282240 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Accept: application/json Jul 21 20:18:36.282240 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Accept-Encoding: identity Jul 21 20:18:36.282240 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Connection: close Jul 21 20:18:36.282240 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Content-Length: 0 Jul 21 20:18:36.282240 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Content-Type: application/json Jul 21 20:18:36.282240 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Host: 10.222.0.58 Jul 21 20:18:36.282240 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Openstack-System-Scope: None Jul 21 20:18:36.282240 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: User-Agent: python-urllib3/1.26.9 Jul 21 20:18:36.282240 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Auth-Token: gAAAAABi2bR8tExYFg-nYPpHOeSFEcMyHHLuXGspn8FnUwhdMS5wi1Vp5UXCR0UeohLV24oSC4esgfj2EQWJrcmKGuoXWX1R94t6d_pZ1F0PGzxSIPK0h-s1NVYX7eXm6wcYQF9sc2LU5rEW6hTTyhps-soqTUs87rt94-tsV0zq4p9sObkvrKE Jul 21 20:18:36.282240 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Domain-Id: None Jul 21 20:18:36.282240 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Domain-Name: None Jul 21 20:18:36.282240 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Identity-Status: Confirmed Jul 21 20:18:36.282240 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Is-Admin-Project: True Jul 21 20:18:36.282240 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Domain-Id: default Jul 21 20:18:36.282240 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Domain-Name: Default Jul 21 20:18:36.282240 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Id: 9872332c8270445f9feacb0d76982f12 Jul 21 20:18:36.282240 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Name: tempest-VolumesNegativeTest-1432514623 Jul 21 20:18:36.282240 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Role: reader,member Jul 21 20:18:36.282240 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Roles: reader,member Jul 21 20:18:36.284023 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9872332c8270445f9feacb0d76982f12"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9872332c8270445f9feacb0d76982f12"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9872332c8270445f9feacb0d76982f12"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9872332c8270445f9feacb0d76982f12"}]}] Jul 21 20:18:36.284023 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Tenant: tempest-VolumesNegativeTest-1432514623 Jul 21 20:18:36.284023 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Tenant-Id: 9872332c8270445f9feacb0d76982f12 Jul 21 20:18:36.284023 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Tenant-Name: tempest-VolumesNegativeTest-1432514623 Jul 21 20:18:36.284023 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User: tempest-VolumesNegativeTest-1432514623-project Jul 21 20:18:36.284023 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Domain-Id: default Jul 21 20:18:36.284023 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Domain-Name: Default Jul 21 20:18:36.284023 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Id: f41baf9558b04546aaa5bf112e4c4fe5 Jul 21 20:18:36.284023 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Name: tempest-VolumesNegativeTest-1432514623-project Jul 21 20:18:36.284023 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: method: > Jul 21 20:18:36.284023 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: exception: Instance 6088dba0-f178-48c2-8fed-1e0c93d88aed could not be found. Jul 21 20:18:36.284023 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: action_args: {'id': '6088dba0-f178-48c2-8fed-1e0c93d88aed'} Jul 21 20:18:36.284846 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 20:18:36.284846 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:18:36.284846 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 20:18:36.284846 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 20:18:36.284846 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 20:18:36.284846 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 20:18:36.284846 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 20:18:36.284846 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 20:18:36.284846 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 20:18:36.284846 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 20:18:36.284846 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6088dba0-f178-48c2-8fed-1e0c93d88aed could not be found. Jul 21 20:18:36.284846 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:18:36.284846 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:18:36.284846 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:18:36.284846 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:18:36.284846 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:18:36.284846 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:18:36.284846 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 20:18:36.284846 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 20:18:36.284846 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 20:18:36.286059 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 20:18:36.286059 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 20:18:36.286059 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 20:18:36.286059 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 20:18:36.286059 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 20:18:36.286059 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 20:18:36.286059 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 20:18:36.286059 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6088dba0-f178-48c2-8fed-1e0c93d88aed could not be found. Jul 21 20:18:36.286059 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:18:36.286059 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:18:36.286059 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:18:36.286059 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:18:36.286059 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:18:36.286059 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:18:36.286059 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 20:18:36.286059 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 20:18:36.286059 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6088dba0-f178-48c2-8fed-1e0c93d88aed could not be found. Jul 21 20:18:36.286059 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:18:36.287206 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-f3e79b7f-7300-4b6e-b244-4f1c7c49fffa tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] Returning 404 to user: Instance 6088dba0-f178-48c2-8fed-1e0c93d88aed could not be found. {{(pid=118344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 20:18:36.287206 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-f3e79b7f-7300-4b6e-b244-4f1c7c49fffa tempest-VolumesNegativeTest-1432514623 tempest-VolumesNegativeTest-1432514623-project] 10.222.0.58 "GET /compute/v2.1/servers/6088dba0-f178-48c2-8fed-1e0c93d88aed" status: 404 len: 111 microversion: 2.1 time: 0.032070 Jul 21 20:18:36.287206 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 568/1155] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:18:36 2022] GET /compute/v2.1/servers/6088dba0-f178-48c2-8fed-1e0c93d88aed => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 21 20:18:36.299778 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-030f446f-4ccd-4864-beca-cff18518f364 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4460571d9294e38931274a55c6c5857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a259cf4b240fba9b065a43b2ed4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:18:36.308343 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-030f446f-4ccd-4864-beca-cff18518f364 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] 10.222.0.58 "GET /compute/v2.1/servers/15930e99-4a7e-48c9-be0d-5b3d91fb044c" status: 200 len: 1265 microversion: 2.1 time: 0.155699 Jul 21 20:18:36.308921 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 588/1156] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:18:36 2022] GET /compute/v2.1/servers/15930e99-4a7e-48c9-be0d-5b3d91fb044c => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:18:37.325684 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-a545a0e2-048c-41fa-8fb9-5346106a8c14 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:18:37.326331 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-a545a0e2-048c-41fa-8fb9-5346106a8c14 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] [instance: 15930e99-4a7e-48c9-be0d-5b3d91fb044c] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:18:37.332964 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-a545a0e2-048c-41fa-8fb9-5346106a8c14 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:37.333404 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-a545a0e2-048c-41fa-8fb9-5346106a8c14 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:37.334169 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-a545a0e2-048c-41fa-8fb9-5346106a8c14 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:37.334607 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-a545a0e2-048c-41fa-8fb9-5346106a8c14 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:37.467501 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-a545a0e2-048c-41fa-8fb9-5346106a8c14 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4460571d9294e38931274a55c6c5857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a259cf4b240fba9b065a43b2ed4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:18:37.482507 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-a545a0e2-048c-41fa-8fb9-5346106a8c14 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] 10.222.0.58 "GET /compute/v2.1/servers/15930e99-4a7e-48c9-be0d-5b3d91fb044c" status: 200 len: 1265 microversion: 2.1 time: 0.161217 Jul 21 20:18:37.486266 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 569/1157] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:18:37 2022] GET /compute/v2.1/servers/15930e99-4a7e-48c9-be0d-5b3d91fb044c => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:18:38.501396 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-445fee42-b35e-4174-a5b4-d47ea99d02df tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:18:38.502123 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-445fee42-b35e-4174-a5b4-d47ea99d02df tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] [instance: 15930e99-4a7e-48c9-be0d-5b3d91fb044c] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:18:38.508623 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-445fee42-b35e-4174-a5b4-d47ea99d02df tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:38.509061 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-445fee42-b35e-4174-a5b4-d47ea99d02df tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:38.509889 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-445fee42-b35e-4174-a5b4-d47ea99d02df tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:38.510367 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-445fee42-b35e-4174-a5b4-d47ea99d02df tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:38.655547 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-445fee42-b35e-4174-a5b4-d47ea99d02df tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4460571d9294e38931274a55c6c5857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a259cf4b240fba9b065a43b2ed4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:18:38.662942 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-445fee42-b35e-4174-a5b4-d47ea99d02df tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] 10.222.0.58 "GET /compute/v2.1/servers/15930e99-4a7e-48c9-be0d-5b3d91fb044c" status: 200 len: 1265 microversion: 2.1 time: 0.165412 Jul 21 20:18:38.663537 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 589/1158] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:18:38 2022] GET /compute/v2.1/servers/15930e99-4a7e-48c9-be0d-5b3d91fb044c => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:18:39.680283 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-876b6dfd-233c-4a38-adb8-ff7e361f6b58 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:18:39.680895 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-876b6dfd-233c-4a38-adb8-ff7e361f6b58 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] [instance: 15930e99-4a7e-48c9-be0d-5b3d91fb044c] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:18:39.687461 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-876b6dfd-233c-4a38-adb8-ff7e361f6b58 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:39.687914 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-876b6dfd-233c-4a38-adb8-ff7e361f6b58 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:39.688676 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-876b6dfd-233c-4a38-adb8-ff7e361f6b58 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:39.689110 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-876b6dfd-233c-4a38-adb8-ff7e361f6b58 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:39.825739 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-876b6dfd-233c-4a38-adb8-ff7e361f6b58 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4460571d9294e38931274a55c6c5857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a259cf4b240fba9b065a43b2ed4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:18:39.833685 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-876b6dfd-233c-4a38-adb8-ff7e361f6b58 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] 10.222.0.58 "GET /compute/v2.1/servers/15930e99-4a7e-48c9-be0d-5b3d91fb044c" status: 200 len: 1265 microversion: 2.1 time: 0.157195 Jul 21 20:18:39.834249 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 570/1159] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:18:39 2022] GET /compute/v2.1/servers/15930e99-4a7e-48c9-be0d-5b3d91fb044c => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:18:40.861712 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-9217edce-a4e5-4c33-9c20-47f869af66f8 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:18:40.862346 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-9217edce-a4e5-4c33-9c20-47f869af66f8 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] [instance: 15930e99-4a7e-48c9-be0d-5b3d91fb044c] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:18:40.864579 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell0:SELECT=4 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:18:40.869989 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-9217edce-a4e5-4c33-9c20-47f869af66f8 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:40.870434 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-9217edce-a4e5-4c33-9c20-47f869af66f8 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:40.871223 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-9217edce-a4e5-4c33-9c20-47f869af66f8 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:40.871661 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-9217edce-a4e5-4c33-9c20-47f869af66f8 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:41.009579 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-9217edce-a4e5-4c33-9c20-47f869af66f8 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4460571d9294e38931274a55c6c5857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a259cf4b240fba9b065a43b2ed4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:18:41.017856 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-9217edce-a4e5-4c33-9c20-47f869af66f8 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] 10.222.0.58 "GET /compute/v2.1/servers/15930e99-4a7e-48c9-be0d-5b3d91fb044c" status: 200 len: 1265 microversion: 2.1 time: 0.160018 Jul 21 20:18:41.018431 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 590/1160] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:18:40 2022] GET /compute/v2.1/servers/15930e99-4a7e-48c9-be0d-5b3d91fb044c => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:18:41.843502 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-a7dc3137-bdf2-4eb8-8a4f-c2acb15841d6 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:18:41.844238 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-a7dc3137-bdf2-4eb8-8a4f-c2acb15841d6 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] [instance: 25c00062-b8e5-4575-a993-bcace67b3682] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:18:41.850790 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-a7dc3137-bdf2-4eb8-8a4f-c2acb15841d6 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:41.851225 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-a7dc3137-bdf2-4eb8-8a4f-c2acb15841d6 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:41.851996 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-a7dc3137-bdf2-4eb8-8a4f-c2acb15841d6 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:41.858987 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-a7dc3137-bdf2-4eb8-8a4f-c2acb15841d6 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:41.996900 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-a7dc3137-bdf2-4eb8-8a4f-c2acb15841d6 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216eb0b454534a878c30a23e9126ff9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c262cd918784d6490dcd78eda61c551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:18:42.005037 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-a7dc3137-bdf2-4eb8-8a4f-c2acb15841d6 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] 10.222.0.58 "GET /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682" status: 200 len: 1594 microversion: 2.1 time: 0.165331 Jul 21 20:18:42.005716 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 571/1161] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:18:41 2022] GET /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682 => generated 1594 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:18:42.036457 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-6713ae03-4eca-4957-b1c7-86e9ce3e7911 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:18:42.037728 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-6713ae03-4eca-4957-b1c7-86e9ce3e7911 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] [instance: 15930e99-4a7e-48c9-be0d-5b3d91fb044c] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:18:42.045064 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6713ae03-4eca-4957-b1c7-86e9ce3e7911 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:42.045514 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6713ae03-4eca-4957-b1c7-86e9ce3e7911 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:42.046289 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6713ae03-4eca-4957-b1c7-86e9ce3e7911 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:42.046722 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6713ae03-4eca-4957-b1c7-86e9ce3e7911 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:42.250431 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-6713ae03-4eca-4957-b1c7-86e9ce3e7911 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4460571d9294e38931274a55c6c5857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a259cf4b240fba9b065a43b2ed4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:18:42.253451 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-6713ae03-4eca-4957-b1c7-86e9ce3e7911 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] 10.222.0.58 "GET /compute/v2.1/servers/15930e99-4a7e-48c9-be0d-5b3d91fb044c" status: 200 len: 1265 microversion: 2.1 time: 0.222118 Jul 21 20:18:42.255388 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 591/1162] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:18:42 2022] GET /compute/v2.1/servers/15930e99-4a7e-48c9-be0d-5b3d91fb044c => generated 1265 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:18:43.110780 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [req-73ccada9-2a95-4094-a73f-5fc1b3e32516 req-16666299-15d9-455b-bb1a-8e92774a4da0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15930e99-4a7e-48c9-be0d-5b3d91fb044c", "name": "network-vif-plugged", "status": "completed", "tag": "fc62afdf-aa2c-456a-b4bd-d7f4981ec4d3"}]} {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:18:43.119270 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [req-73ccada9-2a95-4094-a73f-5fc1b3e32516 req-16666299-15d9-455b-bb1a-8e92774a4da0 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:43.119715 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [req-73ccada9-2a95-4094-a73f-5fc1b3e32516 req-16666299-15d9-455b-bb1a-8e92774a4da0 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:43.131041 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.compute.server_external_events [req-73ccada9-2a95-4094-a73f-5fc1b3e32516 req-16666299-15d9-455b-bb1a-8e92774a4da0 service nova] Creating event network-vif-plugged:fc62afdf-aa2c-456a-b4bd-d7f4981ec4d3 for instance 15930e99-4a7e-48c9-be0d-5b3d91fb044c on hv-cinder-85054 Jul 21 20:18:43.136424 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [req-73ccada9-2a95-4094-a73f-5fc1b3e32516 req-16666299-15d9-455b-bb1a-8e92774a4da0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029318 Jul 21 20:18:43.137030 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 572/1163] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 20:18:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:18:43.271661 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-c4372ac7-3096-4ecd-85a6-e262e912b2de tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:18:43.272292 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-c4372ac7-3096-4ecd-85a6-e262e912b2de tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] [instance: 15930e99-4a7e-48c9-be0d-5b3d91fb044c] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:18:43.291524 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c4372ac7-3096-4ecd-85a6-e262e912b2de tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:43.292125 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c4372ac7-3096-4ecd-85a6-e262e912b2de tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:43.293062 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c4372ac7-3096-4ecd-85a6-e262e912b2de tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:43.293711 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c4372ac7-3096-4ecd-85a6-e262e912b2de tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:43.517945 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-c4372ac7-3096-4ecd-85a6-e262e912b2de tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4460571d9294e38931274a55c6c5857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a259cf4b240fba9b065a43b2ed4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:18:43.526818 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-c4372ac7-3096-4ecd-85a6-e262e912b2de tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] 10.222.0.58 "GET /compute/v2.1/servers/15930e99-4a7e-48c9-be0d-5b3d91fb044c" status: 200 len: 1265 microversion: 2.1 time: 0.258723 Jul 21 20:18:43.537509 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 592/1164] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:18:43 2022] GET /compute/v2.1/servers/15930e99-4a7e-48c9-be0d-5b3d91fb044c => generated 1265 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:18:44.546692 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-bd7d1ac2-52c4-4958-b7f5-05d9ab685dff tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:18:44.547380 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-bd7d1ac2-52c4-4958-b7f5-05d9ab685dff tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] [instance: 15930e99-4a7e-48c9-be0d-5b3d91fb044c] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:18:44.553524 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-bd7d1ac2-52c4-4958-b7f5-05d9ab685dff tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:44.572535 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-bd7d1ac2-52c4-4958-b7f5-05d9ab685dff tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:44.572535 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-bd7d1ac2-52c4-4958-b7f5-05d9ab685dff tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:44.572535 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-bd7d1ac2-52c4-4958-b7f5-05d9ab685dff tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:44.706200 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-bd7d1ac2-52c4-4958-b7f5-05d9ab685dff tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4460571d9294e38931274a55c6c5857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a259cf4b240fba9b065a43b2ed4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:18:44.714246 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-bd7d1ac2-52c4-4958-b7f5-05d9ab685dff tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] 10.222.0.58 "GET /compute/v2.1/servers/15930e99-4a7e-48c9-be0d-5b3d91fb044c" status: 200 len: 1265 microversion: 2.1 time: 0.173358 Jul 21 20:18:44.714822 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 573/1165] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:18:44 2022] GET /compute/v2.1/servers/15930e99-4a7e-48c9-be0d-5b3d91fb044c => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:18:44.789756 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [req-7437a02a-f46b-4ab4-9570-412a3ba7466a req-50e43909-3d66-4433-b124-2fbeec0ab284 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25c00062-b8e5-4575-a993-bcace67b3682", "tag": "eae9dff4-a338-4cab-b3de-c05350da7fab"}]} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:18:44.800278 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-7437a02a-f46b-4ab4-9570-412a3ba7466a req-50e43909-3d66-4433-b124-2fbeec0ab284 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:44.800928 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-7437a02a-f46b-4ab4-9570-412a3ba7466a req-50e43909-3d66-4433-b124-2fbeec0ab284 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:44.813597 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.compute.server_external_events [req-7437a02a-f46b-4ab4-9570-412a3ba7466a req-50e43909-3d66-4433-b124-2fbeec0ab284 service nova] Creating event network-changed:eae9dff4-a338-4cab-b3de-c05350da7fab for instance 25c00062-b8e5-4575-a993-bcace67b3682 on hv-cinder-85054 Jul 21 20:18:44.818156 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [req-7437a02a-f46b-4ab4-9570-412a3ba7466a req-50e43909-3d66-4433-b124-2fbeec0ab284 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031995 Jul 21 20:18:44.818782 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 593/1166] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 20:18:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 20:18:45.732480 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-cf5e9da7-cb65-46aa-a673-f43d96c67571 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:18:45.733129 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-cf5e9da7-cb65-46aa-a673-f43d96c67571 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] [instance: 15930e99-4a7e-48c9-be0d-5b3d91fb044c] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:18:45.739596 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-cf5e9da7-cb65-46aa-a673-f43d96c67571 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:45.740046 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-cf5e9da7-cb65-46aa-a673-f43d96c67571 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:45.740839 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-cf5e9da7-cb65-46aa-a673-f43d96c67571 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:45.741269 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-cf5e9da7-cb65-46aa-a673-f43d96c67571 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:46.237862 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-cf5e9da7-cb65-46aa-a673-f43d96c67571 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4460571d9294e38931274a55c6c5857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a259cf4b240fba9b065a43b2ed4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:18:46.240341 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG dbcounter [-] [118344] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:18:46.247693 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-cf5e9da7-cb65-46aa-a673-f43d96c67571 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] 10.222.0.58 "GET /compute/v2.1/servers/15930e99-4a7e-48c9-be0d-5b3d91fb044c" status: 200 len: 1452 microversion: 2.1 time: 0.519545 Jul 21 20:18:46.249409 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 574/1167] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:18:45 2022] GET /compute/v2.1/servers/15930e99-4a7e-48c9-be0d-5b3d91fb044c => generated 1452 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:18:46.266116 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-fd33d710-6fd3-49c5-ad0e-8bbd6c6f4b8b tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:18:46.267560 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-fd33d710-6fd3-49c5-ad0e-8bbd6c6f4b8b tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] [instance: 15930e99-4a7e-48c9-be0d-5b3d91fb044c] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:18:46.273687 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-fd33d710-6fd3-49c5-ad0e-8bbd6c6f4b8b tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:46.274132 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-fd33d710-6fd3-49c5-ad0e-8bbd6c6f4b8b tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:46.274901 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-fd33d710-6fd3-49c5-ad0e-8bbd6c6f4b8b tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:46.275364 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-fd33d710-6fd3-49c5-ad0e-8bbd6c6f4b8b tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:46.423045 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-fd33d710-6fd3-49c5-ad0e-8bbd6c6f4b8b tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4460571d9294e38931274a55c6c5857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a259cf4b240fba9b065a43b2ed4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:18:46.431829 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-fd33d710-6fd3-49c5-ad0e-8bbd6c6f4b8b tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] 10.222.0.58 "GET /compute/v2.1/servers/15930e99-4a7e-48c9-be0d-5b3d91fb044c" status: 200 len: 1452 microversion: 2.1 time: 0.171328 Jul 21 20:18:46.433524 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 594/1168] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:18:46 2022] GET /compute/v2.1/servers/15930e99-4a7e-48c9-be0d-5b3d91fb044c => generated 1452 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:18:47.038631 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-a56c50cb-572b-4a7c-a9ae-ee9aaef5ecd3 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1852702182", "imageRef": "357a1479-6cbd-4882-8d3f-d945fa40e6df", "flavorRef": "452", "networks": [{"uuid": "eba7847f-38f7-4524-be74-2836b06a25d5"}]}} {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:18:47.104894 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.network.neutron [None req-a56c50cb-572b-4a7c-a9ae-ee9aaef5ecd3 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] validate_networks() for [('eba7847f-38f7-4524-be74-2836b06a25d5', None, None, None, None, None)] {{(pid=118344) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 20:18:47.277655 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-1296d939-cd24-48ac-8961-8ad72b5f9e30 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-973213736"}} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:18:47.278279 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-1296d939-cd24-48ac-8961-8ad72b5f9e30 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] [instance: 25c00062-b8e5-4575-a993-bcace67b3682] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:18:47.284879 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1296d939-cd24-48ac-8961-8ad72b5f9e30 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:47.285434 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1296d939-cd24-48ac-8961-8ad72b5f9e30 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:47.286286 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1296d939-cd24-48ac-8961-8ad72b5f9e30 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:47.286787 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1296d939-cd24-48ac-8961-8ad72b5f9e30 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:47.523970 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.network.security_group_api [None req-1296d939-cd24-48ac-8961-8ad72b5f9e30 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Adding security group ece0226d-86ac-4d8a-ab26-4b8ecf68b1f2 to port eae9dff4-a338-4cab-b3de-c05350da7fab Jul 21 20:18:47.531999 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.virt.hardware [None req-a56c50cb-572b-4a7c-a9ae-ee9aaef5ecd3 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Flavor limits 0:0:0 {{(pid=118344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 20:18:47.532430 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.virt.hardware [None req-a56c50cb-572b-4a7c-a9ae-ee9aaef5ecd3 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Image limits 0:0:0 {{(pid=118344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 20:18:47.533081 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.virt.hardware [None req-a56c50cb-572b-4a7c-a9ae-ee9aaef5ecd3 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Flavor pref 0:0:0 {{(pid=118344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 20:18:47.533501 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.virt.hardware [None req-a56c50cb-572b-4a7c-a9ae-ee9aaef5ecd3 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Image pref 0:0:0 {{(pid=118344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 20:18:47.533920 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.virt.hardware [None req-a56c50cb-572b-4a7c-a9ae-ee9aaef5ecd3 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 20:18:47.543232 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-a56c50cb-572b-4a7c-a9ae-ee9aaef5ecd3 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:47.543771 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-a56c50cb-572b-4a7c-a9ae-ee9aaef5ecd3 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:47.544825 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-a56c50cb-572b-4a7c-a9ae-ee9aaef5ecd3 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:47.545323 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-a56c50cb-572b-4a7c-a9ae-ee9aaef5ecd3 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:47.562575 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.quota [None req-a56c50cb-572b-4a7c-a9ae-ee9aaef5ecd3 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Getting quotas for project fc37aee55036430bb0627cdc2cd61011. Resources: {'instances', 'cores', 'ram'} {{(pid=118344) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 20:18:47.566561 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.quota [None req-a56c50cb-572b-4a7c-a9ae-ee9aaef5ecd3 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Getting quotas for user 522e94fb0637414a9ceb96f3b8aa3003 and project fc37aee55036430bb0627cdc2cd61011. Resources: {'instances', 'cores', 'ram'} {{(pid=118344) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 20:18:47.577675 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-a56c50cb-572b-4a7c-a9ae-ee9aaef5ecd3 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Going to run 1 instances... {{(pid=118344) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 20:18:47.580001 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-a56c50cb-572b-4a7c-a9ae-ee9aaef5ecd3 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] [instance: 3220536d-878a-4fd9-ab58-15a5c060f6e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='357a1479-6cbd-4882-8d3f-d945fa40e6df',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118344) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 20:18:47.686867 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-a56c50cb-572b-4a7c-a9ae-ee9aaef5ecd3 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.652067 Jul 21 20:18:47.687839 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 575/1169] 10.222.0.58 () {60 vars in 1146 bytes} [Thu Jul 21 20:18:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 654 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 21 20:18:47.698389 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-de089ac2-63de-47ce-8acd-83c7814c5ecd tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:18:47.699313 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-de089ac2-63de-47ce-8acd-83c7814c5ecd tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] [instance: 3220536d-878a-4fd9-ab58-15a5c060f6e0] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:18:47.769113 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-de089ac2-63de-47ce-8acd-83c7814c5ecd tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522e94fb0637414a9ceb96f3b8aa3003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc37aee55036430bb0627cdc2cd61011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:18:47.778281 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-de089ac2-63de-47ce-8acd-83c7814c5ecd tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] 10.222.0.58 "GET /compute/v2.1/servers/3220536d-878a-4fd9-ab58-15a5c060f6e0" status: 200 len: 1219 microversion: 2.1 time: 0.084218 Jul 21 20:18:47.779074 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 576/1170] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:18:47 2022] GET /compute/v2.1/servers/3220536d-878a-4fd9-ab58-15a5c060f6e0 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:18:48.097975 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-1296d939-cd24-48ac-8961-8ad72b5f9e30 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] 10.222.0.58 "POST /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682/action" status: 202 len: 0 microversion: 2.1 time: 0.823539 Jul 21 20:18:48.099971 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 595/1171] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Jul 21 20:18:47 2022] POST /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682/action => generated 0 bytes in 827 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 21 20:18:48.108837 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-fb660b7f-80aa-49d7-9408-537e22345e6b tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:18:48.109454 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-fb660b7f-80aa-49d7-9408-537e22345e6b tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] [instance: 25c00062-b8e5-4575-a993-bcace67b3682] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:18:48.116481 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-fb660b7f-80aa-49d7-9408-537e22345e6b tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:48.117372 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-fb660b7f-80aa-49d7-9408-537e22345e6b tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:48.118364 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-fb660b7f-80aa-49d7-9408-537e22345e6b tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:48.118801 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-fb660b7f-80aa-49d7-9408-537e22345e6b tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:48.128001 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [req-3d489238-e165-4262-ad7b-1a1da648d6a4 req-4e1ffa14-4916-4b3f-8bfe-28dadb6d028e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25c00062-b8e5-4575-a993-bcace67b3682", "tag": "eae9dff4-a338-4cab-b3de-c05350da7fab"}]} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:18:48.145189 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-3d489238-e165-4262-ad7b-1a1da648d6a4 req-4e1ffa14-4916-4b3f-8bfe-28dadb6d028e service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:48.145936 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-3d489238-e165-4262-ad7b-1a1da648d6a4 req-4e1ffa14-4916-4b3f-8bfe-28dadb6d028e service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:48.181021 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.compute.server_external_events [req-3d489238-e165-4262-ad7b-1a1da648d6a4 req-4e1ffa14-4916-4b3f-8bfe-28dadb6d028e service nova] Creating event network-changed:eae9dff4-a338-4cab-b3de-c05350da7fab for instance 25c00062-b8e5-4575-a993-bcace67b3682 on hv-cinder-85054 Jul 21 20:18:48.193633 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [req-3d489238-e165-4262-ad7b-1a1da648d6a4 req-4e1ffa14-4916-4b3f-8bfe-28dadb6d028e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068390 Jul 21 20:18:48.194969 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 596/1172] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 20:18:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:18:48.442779 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-fb660b7f-80aa-49d7-9408-537e22345e6b tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216eb0b454534a878c30a23e9126ff9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c262cd918784d6490dcd78eda61c551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:18:48.452781 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-fb660b7f-80aa-49d7-9408-537e22345e6b tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] 10.222.0.58 "GET /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682" status: 200 len: 1758 microversion: 2.1 time: 0.348276 Jul 21 20:18:48.459001 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 577/1173] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:18:48 2022] GET /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682 => generated 1758 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:18:48.798343 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-3a752794-c221-47b0-b9bd-5ccc4131b252 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:18:48.800110 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-3a752794-c221-47b0-b9bd-5ccc4131b252 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] [instance: 3220536d-878a-4fd9-ab58-15a5c060f6e0] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:18:48.822366 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3a752794-c221-47b0-b9bd-5ccc4131b252 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:48.822847 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3a752794-c221-47b0-b9bd-5ccc4131b252 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:48.823665 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3a752794-c221-47b0-b9bd-5ccc4131b252 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:48.824127 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3a752794-c221-47b0-b9bd-5ccc4131b252 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:48.929741 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-3a752794-c221-47b0-b9bd-5ccc4131b252 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522e94fb0637414a9ceb96f3b8aa3003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc37aee55036430bb0627cdc2cd61011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:18:48.940873 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-3a752794-c221-47b0-b9bd-5ccc4131b252 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] 10.222.0.58 "GET /compute/v2.1/servers/3220536d-878a-4fd9-ab58-15a5c060f6e0" status: 200 len: 1223 microversion: 2.1 time: 0.147517 Jul 21 20:18:48.942166 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 597/1174] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:18:48 2022] GET /compute/v2.1/servers/3220536d-878a-4fd9-ab58-15a5c060f6e0 => generated 1223 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:18:49.958701 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-8c2ec556-1eb0-4759-9795-09f80cbdfdc5 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:18:49.959371 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-8c2ec556-1eb0-4759-9795-09f80cbdfdc5 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] [instance: 3220536d-878a-4fd9-ab58-15a5c060f6e0] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:18:49.966339 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-8c2ec556-1eb0-4759-9795-09f80cbdfdc5 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:49.966794 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-8c2ec556-1eb0-4759-9795-09f80cbdfdc5 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:49.968105 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-8c2ec556-1eb0-4759-9795-09f80cbdfdc5 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:49.968679 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-8c2ec556-1eb0-4759-9795-09f80cbdfdc5 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:50.044937 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-8c2ec556-1eb0-4759-9795-09f80cbdfdc5 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522e94fb0637414a9ceb96f3b8aa3003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc37aee55036430bb0627cdc2cd61011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:18:50.053095 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-8c2ec556-1eb0-4759-9795-09f80cbdfdc5 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] 10.222.0.58 "GET /compute/v2.1/servers/3220536d-878a-4fd9-ab58-15a5c060f6e0" status: 200 len: 1279 microversion: 2.1 time: 0.098491 Jul 21 20:18:50.053663 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 578/1175] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:18:49 2022] GET /compute/v2.1/servers/3220536d-878a-4fd9-ab58-15a5c060f6e0 => generated 1279 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:18:50.233649 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [req-08cbeac9-fbe3-4a0e-893d-0c2f494ec77c req-f8adb91c-8620-4d25-a0ce-43fc90e22b8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15930e99-4a7e-48c9-be0d-5b3d91fb044c", "tag": "fc62afdf-aa2c-456a-b4bd-d7f4981ec4d3"}]} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:18:50.242059 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-08cbeac9-fbe3-4a0e-893d-0c2f494ec77c req-f8adb91c-8620-4d25-a0ce-43fc90e22b8d service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:50.242510 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-08cbeac9-fbe3-4a0e-893d-0c2f494ec77c req-f8adb91c-8620-4d25-a0ce-43fc90e22b8d service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:50.253814 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.compute.server_external_events [req-08cbeac9-fbe3-4a0e-893d-0c2f494ec77c req-f8adb91c-8620-4d25-a0ce-43fc90e22b8d service nova] Creating event network-changed:fc62afdf-aa2c-456a-b4bd-d7f4981ec4d3 for instance 15930e99-4a7e-48c9-be0d-5b3d91fb044c on hv-cinder-85054 Jul 21 20:18:50.258447 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [req-08cbeac9-fbe3-4a0e-893d-0c2f494ec77c req-f8adb91c-8620-4d25-a0ce-43fc90e22b8d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028994 Jul 21 20:18:50.259536 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 598/1176] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 20:18:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:18:51.071172 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-0506b5df-2853-4ce9-88ed-bc914f78887a tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:18:51.072071 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-0506b5df-2853-4ce9-88ed-bc914f78887a tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] [instance: 3220536d-878a-4fd9-ab58-15a5c060f6e0] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:18:51.079179 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-0506b5df-2853-4ce9-88ed-bc914f78887a tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:51.079698 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-0506b5df-2853-4ce9-88ed-bc914f78887a tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:51.083981 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-0506b5df-2853-4ce9-88ed-bc914f78887a tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:51.083981 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-0506b5df-2853-4ce9-88ed-bc914f78887a tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:51.266851 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-0506b5df-2853-4ce9-88ed-bc914f78887a tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522e94fb0637414a9ceb96f3b8aa3003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc37aee55036430bb0627cdc2cd61011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:18:51.274236 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-0506b5df-2853-4ce9-88ed-bc914f78887a tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] 10.222.0.58 "GET /compute/v2.1/servers/3220536d-878a-4fd9-ab58-15a5c060f6e0" status: 200 len: 1319 microversion: 2.1 time: 0.207122 Jul 21 20:18:51.275010 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 579/1177] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:18:51 2022] GET /compute/v2.1/servers/3220536d-878a-4fd9-ab58-15a5c060f6e0 => generated 1319 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:18:51.673406 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [req-dd3072ef-f8cc-4d71-b353-f477f4243de6 req-a590b134-9f1a-4923-bd2b-8321aca130b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3220536d-878a-4fd9-ab58-15a5c060f6e0", "tag": "347eb686-6aa9-4c63-9e05-1f0f4438d7cb"}]} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:18:51.682733 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-dd3072ef-f8cc-4d71-b353-f477f4243de6 req-a590b134-9f1a-4923-bd2b-8321aca130b4 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:51.683216 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-dd3072ef-f8cc-4d71-b353-f477f4243de6 req-a590b134-9f1a-4923-bd2b-8321aca130b4 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:51.694475 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.compute.server_external_events [req-dd3072ef-f8cc-4d71-b353-f477f4243de6 req-a590b134-9f1a-4923-bd2b-8321aca130b4 service nova] Creating event network-changed:347eb686-6aa9-4c63-9e05-1f0f4438d7cb for instance 3220536d-878a-4fd9-ab58-15a5c060f6e0 on hv-cinder-85054 Jul 21 20:18:51.699294 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [req-dd3072ef-f8cc-4d71-b353-f477f4243de6 req-a590b134-9f1a-4923-bd2b-8321aca130b4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030427 Jul 21 20:18:51.704657 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 599/1178] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 20:18:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:18:52.291922 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-eb233db1-dd40-44bd-80cf-716ee6ddf5e6 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:18:52.292606 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-eb233db1-dd40-44bd-80cf-716ee6ddf5e6 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] [instance: 3220536d-878a-4fd9-ab58-15a5c060f6e0] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:18:52.301240 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-eb233db1-dd40-44bd-80cf-716ee6ddf5e6 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:52.301798 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-eb233db1-dd40-44bd-80cf-716ee6ddf5e6 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:52.302671 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-eb233db1-dd40-44bd-80cf-716ee6ddf5e6 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:52.303209 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-eb233db1-dd40-44bd-80cf-716ee6ddf5e6 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:52.502897 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-eb233db1-dd40-44bd-80cf-716ee6ddf5e6 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522e94fb0637414a9ceb96f3b8aa3003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc37aee55036430bb0627cdc2cd61011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:18:52.510423 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-eb233db1-dd40-44bd-80cf-716ee6ddf5e6 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] 10.222.0.58 "GET /compute/v2.1/servers/3220536d-878a-4fd9-ab58-15a5c060f6e0" status: 200 len: 1319 microversion: 2.1 time: 0.222453 Jul 21 20:18:52.511138 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 580/1179] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:18:52 2022] GET /compute/v2.1/servers/3220536d-878a-4fd9-ab58-15a5c060f6e0 => generated 1319 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:18:53.527867 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-aae34743-6289-4873-ab9b-96f704b45060 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:18:53.528581 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-aae34743-6289-4873-ab9b-96f704b45060 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] [instance: 3220536d-878a-4fd9-ab58-15a5c060f6e0] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:18:53.534671 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-aae34743-6289-4873-ab9b-96f704b45060 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:53.535141 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-aae34743-6289-4873-ab9b-96f704b45060 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:53.535887 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-aae34743-6289-4873-ab9b-96f704b45060 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:53.536311 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-aae34743-6289-4873-ab9b-96f704b45060 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:53.666877 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-aae34743-6289-4873-ab9b-96f704b45060 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522e94fb0637414a9ceb96f3b8aa3003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc37aee55036430bb0627cdc2cd61011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:18:53.674655 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-aae34743-6289-4873-ab9b-96f704b45060 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] 10.222.0.58 "GET /compute/v2.1/servers/3220536d-878a-4fd9-ab58-15a5c060f6e0" status: 200 len: 1319 microversion: 2.1 time: 0.151549 Jul 21 20:18:53.675309 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 600/1180] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:18:53 2022] GET /compute/v2.1/servers/3220536d-878a-4fd9-ab58-15a5c060f6e0 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:18:54.692252 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-95620f62-a3ca-4d3b-b1e6-dc311c68dde9 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:18:54.692857 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-95620f62-a3ca-4d3b-b1e6-dc311c68dde9 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] [instance: 3220536d-878a-4fd9-ab58-15a5c060f6e0] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:18:54.700015 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-95620f62-a3ca-4d3b-b1e6-dc311c68dde9 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:54.700455 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-95620f62-a3ca-4d3b-b1e6-dc311c68dde9 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:54.701199 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-95620f62-a3ca-4d3b-b1e6-dc311c68dde9 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:54.701623 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-95620f62-a3ca-4d3b-b1e6-dc311c68dde9 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:54.833066 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-95620f62-a3ca-4d3b-b1e6-dc311c68dde9 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522e94fb0637414a9ceb96f3b8aa3003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc37aee55036430bb0627cdc2cd61011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:18:54.840431 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-95620f62-a3ca-4d3b-b1e6-dc311c68dde9 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] 10.222.0.58 "GET /compute/v2.1/servers/3220536d-878a-4fd9-ab58-15a5c060f6e0" status: 200 len: 1319 microversion: 2.1 time: 0.152201 Jul 21 20:18:54.840986 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 581/1181] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:18:54 2022] GET /compute/v2.1/servers/3220536d-878a-4fd9-ab58-15a5c060f6e0 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:18:55.856950 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-3de3165a-6fa3-4753-98c2-6d89cac8d144 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:18:55.857470 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-3de3165a-6fa3-4753-98c2-6d89cac8d144 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] [instance: 3220536d-878a-4fd9-ab58-15a5c060f6e0] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:18:55.859909 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_api:SELECT=61 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:18:55.864650 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3de3165a-6fa3-4753-98c2-6d89cac8d144 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:55.865099 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3de3165a-6fa3-4753-98c2-6d89cac8d144 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:55.865857 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3de3165a-6fa3-4753-98c2-6d89cac8d144 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:55.866293 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3de3165a-6fa3-4753-98c2-6d89cac8d144 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:56.249975 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-3de3165a-6fa3-4753-98c2-6d89cac8d144 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522e94fb0637414a9ceb96f3b8aa3003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc37aee55036430bb0627cdc2cd61011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:18:56.257425 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-3de3165a-6fa3-4753-98c2-6d89cac8d144 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] 10.222.0.58 "GET /compute/v2.1/servers/3220536d-878a-4fd9-ab58-15a5c060f6e0" status: 200 len: 1319 microversion: 2.1 time: 0.404394 Jul 21 20:18:56.257991 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 601/1182] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:18:55 2022] GET /compute/v2.1/servers/3220536d-878a-4fd9-ab58-15a5c060f6e0 => generated 1319 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:18:57.202741 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [req-af8417d4-378f-4981-a581-06b733856221 req-1a0f1027-a039-4dd4-b086-69f87a2956c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3220536d-878a-4fd9-ab58-15a5c060f6e0", "name": "network-vif-plugged", "status": "completed", "tag": "347eb686-6aa9-4c63-9e05-1f0f4438d7cb"}]} {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:18:57.211047 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [req-af8417d4-378f-4981-a581-06b733856221 req-1a0f1027-a039-4dd4-b086-69f87a2956c2 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:57.211516 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [req-af8417d4-378f-4981-a581-06b733856221 req-1a0f1027-a039-4dd4-b086-69f87a2956c2 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:57.222447 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.compute.server_external_events [req-af8417d4-378f-4981-a581-06b733856221 req-1a0f1027-a039-4dd4-b086-69f87a2956c2 service nova] Creating event network-vif-plugged:347eb686-6aa9-4c63-9e05-1f0f4438d7cb for instance 3220536d-878a-4fd9-ab58-15a5c060f6e0 on hv-cinder-85054 Jul 21 20:18:57.227369 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [req-af8417d4-378f-4981-a581-06b733856221 req-1a0f1027-a039-4dd4-b086-69f87a2956c2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028258 Jul 21 20:18:57.227938 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 582/1183] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 20:18:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:18:57.274188 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-a255e704-e732-4258-8f7e-798b9d004dde tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:18:57.284079 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-a255e704-e732-4258-8f7e-798b9d004dde tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] [instance: 3220536d-878a-4fd9-ab58-15a5c060f6e0] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:18:57.291045 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a255e704-e732-4258-8f7e-798b9d004dde tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:57.292058 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a255e704-e732-4258-8f7e-798b9d004dde tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:57.292851 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a255e704-e732-4258-8f7e-798b9d004dde tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:57.293281 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a255e704-e732-4258-8f7e-798b9d004dde tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:57.312650 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell1:SELECT=100 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:18:57.426559 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-a255e704-e732-4258-8f7e-798b9d004dde tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522e94fb0637414a9ceb96f3b8aa3003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc37aee55036430bb0627cdc2cd61011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:18:57.434063 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-a255e704-e732-4258-8f7e-798b9d004dde tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] 10.222.0.58 "GET /compute/v2.1/servers/3220536d-878a-4fd9-ab58-15a5c060f6e0" status: 200 len: 1319 microversion: 2.1 time: 0.163914 Jul 21 20:18:57.440416 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 602/1184] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:18:57 2022] GET /compute/v2.1/servers/3220536d-878a-4fd9-ab58-15a5c060f6e0 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:18:58.448031 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG dbcounter [-] [118344] Writing DB stats nova_cell0:SELECT=2 {{(pid=118344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:18:58.448837 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG dbcounter [-] [118344] Writing DB stats nova_cell0:SELECT=8 {{(pid=118344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:18:58.454018 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-1e61ef0b-fec6-42b7-8ab0-abe5e41be065 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:18:58.454724 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-1e61ef0b-fec6-42b7-8ab0-abe5e41be065 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] [instance: 3220536d-878a-4fd9-ab58-15a5c060f6e0] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:18:58.460805 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-1e61ef0b-fec6-42b7-8ab0-abe5e41be065 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:58.461255 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-1e61ef0b-fec6-42b7-8ab0-abe5e41be065 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:58.462017 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-1e61ef0b-fec6-42b7-8ab0-abe5e41be065 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:58.462453 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-1e61ef0b-fec6-42b7-8ab0-abe5e41be065 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:58.590366 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-1e61ef0b-fec6-42b7-8ab0-abe5e41be065 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522e94fb0637414a9ceb96f3b8aa3003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc37aee55036430bb0627cdc2cd61011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:18:58.597934 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-1e61ef0b-fec6-42b7-8ab0-abe5e41be065 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] 10.222.0.58 "GET /compute/v2.1/servers/3220536d-878a-4fd9-ab58-15a5c060f6e0" status: 200 len: 1319 microversion: 2.1 time: 0.150873 Jul 21 20:18:58.598491 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 583/1185] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:18:58 2022] GET /compute/v2.1/servers/3220536d-878a-4fd9-ab58-15a5c060f6e0 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:18:59.614448 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-f03a3254-a195-46df-9b25-cbf20bb13d4e tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:18:59.615086 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-f03a3254-a195-46df-9b25-cbf20bb13d4e tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] [instance: 3220536d-878a-4fd9-ab58-15a5c060f6e0] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:18:59.621499 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f03a3254-a195-46df-9b25-cbf20bb13d4e tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:59.622100 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f03a3254-a195-46df-9b25-cbf20bb13d4e tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:59.623423 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f03a3254-a195-46df-9b25-cbf20bb13d4e tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:18:59.623897 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f03a3254-a195-46df-9b25-cbf20bb13d4e tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:18:59.760911 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-f03a3254-a195-46df-9b25-cbf20bb13d4e tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522e94fb0637414a9ceb96f3b8aa3003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc37aee55036430bb0627cdc2cd61011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:18:59.768997 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-f03a3254-a195-46df-9b25-cbf20bb13d4e tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] 10.222.0.58 "GET /compute/v2.1/servers/3220536d-878a-4fd9-ab58-15a5c060f6e0" status: 200 len: 1319 microversion: 2.1 time: 0.158437 Jul 21 20:18:59.769566 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 603/1186] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:18:59 2022] GET /compute/v2.1/servers/3220536d-878a-4fd9-ab58-15a5c060f6e0 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:19:00.786473 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-24755e8b-02e6-4da1-9fb4-4e3c22415f5d tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:19:00.787095 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-24755e8b-02e6-4da1-9fb4-4e3c22415f5d tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] [instance: 3220536d-878a-4fd9-ab58-15a5c060f6e0] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:19:00.789438 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG dbcounter [-] [118344] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:19:00.794179 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-24755e8b-02e6-4da1-9fb4-4e3c22415f5d tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:19:00.801199 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-24755e8b-02e6-4da1-9fb4-4e3c22415f5d tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:19:00.801199 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-24755e8b-02e6-4da1-9fb4-4e3c22415f5d tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:19:00.801199 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-24755e8b-02e6-4da1-9fb4-4e3c22415f5d tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:19:00.933126 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-24755e8b-02e6-4da1-9fb4-4e3c22415f5d tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522e94fb0637414a9ceb96f3b8aa3003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc37aee55036430bb0627cdc2cd61011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:19:00.941143 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-24755e8b-02e6-4da1-9fb4-4e3c22415f5d tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] 10.222.0.58 "GET /compute/v2.1/servers/3220536d-878a-4fd9-ab58-15a5c060f6e0" status: 200 len: 1508 microversion: 2.1 time: 0.158586 Jul 21 20:19:00.941711 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 584/1187] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:19:00 2022] GET /compute/v2.1/servers/3220536d-878a-4fd9-ab58-15a5c060f6e0 => generated 1508 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:19:24.748428 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-04632827-7a26-4443-9f89-5c6361598901 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ccafe410-af4b-450a-8d84-089edb4d5426", "device": "/dev/sdb"}} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:19:24.750512 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-04632827-7a26-4443-9f89-5c6361598901 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] [instance: 3220536d-878a-4fd9-ab58-15a5c060f6e0] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:19:24.753078 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_api:SELECT=5 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:19:24.753737 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell1:SELECT=8 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:19:24.758417 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-04632827-7a26-4443-9f89-5c6361598901 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:19:24.758864 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-04632827-7a26-4443-9f89-5c6361598901 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:19:24.759661 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-04632827-7a26-4443-9f89-5c6361598901 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:19:24.760104 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-04632827-7a26-4443-9f89-5c6361598901 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:19:25.430037 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-04632827-7a26-4443-9f89-5c6361598901 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] 10.222.0.58 "POST /compute/v2.1/servers/3220536d-878a-4fd9-ab58-15a5c060f6e0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.685379 Jul 21 20:19:25.430708 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 604/1188] 10.222.0.58 () {60 vars in 1322 bytes} [Thu Jul 21 20:19:24 2022] POST /compute/v2.1/servers/3220536d-878a-4fd9-ab58-15a5c060f6e0/os-volume_attachments => generated 194 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:19:52.919133 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-d36af568-3354-4fb0-9273-e2d14d3f7d56 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:19:52.919666 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-d36af568-3354-4fb0-9273-e2d14d3f7d56 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] [instance: 3220536d-878a-4fd9-ab58-15a5c060f6e0] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:19:52.921919 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG dbcounter [-] [118344] Writing DB stats nova_api:SELECT=1 {{(pid=118344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:19:52.922619 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG dbcounter [-] [118344] Writing DB stats nova_cell1:SELECT=47 {{(pid=118344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:19:52.928521 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-d36af568-3354-4fb0-9273-e2d14d3f7d56 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:19:52.928970 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-d36af568-3354-4fb0-9273-e2d14d3f7d56 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:19:52.929764 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-d36af568-3354-4fb0-9273-e2d14d3f7d56 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:19:52.930197 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-d36af568-3354-4fb0-9273-e2d14d3f7d56 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:19:53.134107 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.objects.instance [None req-d36af568-3354-4fb0-9273-e2d14d3f7d56 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lazy-loading 'services' on Instance uuid 3220536d-878a-4fd9-ab58-15a5c060f6e0 {{(pid=118344) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 20:19:53.315914 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-d36af568-3354-4fb0-9273-e2d14d3f7d56 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] 10.222.0.58 "DELETE /compute/v2.1/servers/3220536d-878a-4fd9-ab58-15a5c060f6e0/os-volume_attachments/ccafe410-af4b-450a-8d84-089edb4d5426" status: 202 len: 0 microversion: 2.1 time: 0.400558 Jul 21 20:19:53.316559 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 585/1189] 10.222.0.58 () {58 vars in 1415 bytes} [Thu Jul 21 20:19:52 2022] DELETE /compute/v2.1/servers/3220536d-878a-4fd9-ab58-15a5c060f6e0/os-volume_attachments/ccafe410-af4b-450a-8d84-089edb4d5426 => generated 0 bytes in 402 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 20:19:55.481494 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_api:SELECT=2 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:19:55.482238 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:19:55.486314 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-ce855477-1528-4e8f-b692-7fcd75af1183 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:19:55.486888 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-ce855477-1528-4e8f-b692-7fcd75af1183 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] [instance: 3220536d-878a-4fd9-ab58-15a5c060f6e0] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:19:55.493471 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ce855477-1528-4e8f-b692-7fcd75af1183 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:19:55.496973 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ce855477-1528-4e8f-b692-7fcd75af1183 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:19:55.496973 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ce855477-1528-4e8f-b692-7fcd75af1183 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:19:55.496973 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ce855477-1528-4e8f-b692-7fcd75af1183 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:19:55.521244 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-ce855477-1528-4e8f-b692-7fcd75af1183 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] [instance: 3220536d-878a-4fd9-ab58-15a5c060f6e0] Going to try to terminate instance {{(pid=118345) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 20:19:55.813682 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-ce855477-1528-4e8f-b692-7fcd75af1183 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] 10.222.0.58 "DELETE /compute/v2.1/servers/3220536d-878a-4fd9-ab58-15a5c060f6e0" status: 204 len: 0 microversion: 2.1 time: 0.333197 Jul 21 20:19:55.814206 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 605/1190] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Jul 21 20:19:55 2022] DELETE /compute/v2.1/servers/3220536d-878a-4fd9-ab58-15a5c060f6e0 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 20:19:55.824235 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-49e1811d-718f-40a6-85f4-22c2ba4b3acd tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:19:55.824933 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-49e1811d-718f-40a6-85f4-22c2ba4b3acd tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] [instance: 3220536d-878a-4fd9-ab58-15a5c060f6e0] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:19:55.831896 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-49e1811d-718f-40a6-85f4-22c2ba4b3acd tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:19:55.832340 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-49e1811d-718f-40a6-85f4-22c2ba4b3acd tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:19:55.833107 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-49e1811d-718f-40a6-85f4-22c2ba4b3acd tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:19:55.833568 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-49e1811d-718f-40a6-85f4-22c2ba4b3acd tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:19:55.964080 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-49e1811d-718f-40a6-85f4-22c2ba4b3acd tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522e94fb0637414a9ceb96f3b8aa3003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc37aee55036430bb0627cdc2cd61011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:19:55.971821 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-49e1811d-718f-40a6-85f4-22c2ba4b3acd tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] 10.222.0.58 "GET /compute/v2.1/servers/3220536d-878a-4fd9-ab58-15a5c060f6e0" status: 200 len: 1514 microversion: 2.1 time: 0.152472 Jul 21 20:19:55.972376 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 586/1191] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:19:55 2022] GET /compute/v2.1/servers/3220536d-878a-4fd9-ab58-15a5c060f6e0 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:19:56.989659 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-45470649-2376-4797-97da-d92a42a9149b tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:19:56.990272 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-45470649-2376-4797-97da-d92a42a9149b tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] [instance: 3220536d-878a-4fd9-ab58-15a5c060f6e0] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:19:56.996721 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-45470649-2376-4797-97da-d92a42a9149b tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:19:56.997157 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-45470649-2376-4797-97da-d92a42a9149b tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:19:56.997903 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-45470649-2376-4797-97da-d92a42a9149b tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:19:56.998327 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-45470649-2376-4797-97da-d92a42a9149b tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:19:57.178383 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-45470649-2376-4797-97da-d92a42a9149b tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522e94fb0637414a9ceb96f3b8aa3003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc37aee55036430bb0627cdc2cd61011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:19:57.185995 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-45470649-2376-4797-97da-d92a42a9149b tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] 10.222.0.58 "GET /compute/v2.1/servers/3220536d-878a-4fd9-ab58-15a5c060f6e0" status: 200 len: 1514 microversion: 2.1 time: 0.200668 Jul 21 20:19:57.186563 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 606/1192] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:19:56 2022] GET /compute/v2.1/servers/3220536d-878a-4fd9-ab58-15a5c060f6e0 => generated 1514 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:19:58.208070 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-5b13ab8c-1eb1-4d87-ba6a-909dcff3b023 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:19:58.208070 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-5b13ab8c-1eb1-4d87-ba6a-909dcff3b023 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] [instance: 3220536d-878a-4fd9-ab58-15a5c060f6e0] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:19:58.209483 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-5b13ab8c-1eb1-4d87-ba6a-909dcff3b023 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:19:58.209925 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-5b13ab8c-1eb1-4d87-ba6a-909dcff3b023 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:19:58.210678 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-5b13ab8c-1eb1-4d87-ba6a-909dcff3b023 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:19:58.211135 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-5b13ab8c-1eb1-4d87-ba6a-909dcff3b023 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:19:58.417499 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [req-6ea539e1-9e24-45f6-a77d-8d3a791407b7 req-5e1a7bc8-fdff-4c8c-9e39-d5acd1e88715 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3220536d-878a-4fd9-ab58-15a5c060f6e0", "name": "network-vif-deleted", "tag": "347eb686-6aa9-4c63-9e05-1f0f4438d7cb"}]} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:19:58.426670 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-6ea539e1-9e24-45f6-a77d-8d3a791407b7 req-5e1a7bc8-fdff-4c8c-9e39-d5acd1e88715 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:19:58.427137 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-6ea539e1-9e24-45f6-a77d-8d3a791407b7 req-5e1a7bc8-fdff-4c8c-9e39-d5acd1e88715 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:19:58.429443 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-5b13ab8c-1eb1-4d87-ba6a-909dcff3b023 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522e94fb0637414a9ceb96f3b8aa3003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc37aee55036430bb0627cdc2cd61011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:19:58.435169 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-5b13ab8c-1eb1-4d87-ba6a-909dcff3b023 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] 10.222.0.58 "GET /compute/v2.1/servers/3220536d-878a-4fd9-ab58-15a5c060f6e0" status: 200 len: 1514 microversion: 2.1 time: 0.236622 Jul 21 20:19:58.436038 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 587/1193] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:19:58 2022] GET /compute/v2.1/servers/3220536d-878a-4fd9-ab58-15a5c060f6e0 => generated 1514 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:19:58.441265 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.compute.server_external_events [req-6ea539e1-9e24-45f6-a77d-8d3a791407b7 req-5e1a7bc8-fdff-4c8c-9e39-d5acd1e88715 service nova] Creating event network-vif-deleted:347eb686-6aa9-4c63-9e05-1f0f4438d7cb for instance 3220536d-878a-4fd9-ab58-15a5c060f6e0 on hv-cinder-85054 Jul 21 20:19:58.446141 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [req-6ea539e1-9e24-45f6-a77d-8d3a791407b7 req-5e1a7bc8-fdff-4c8c-9e39-d5acd1e88715 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032526 Jul 21 20:19:58.446719 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 607/1194] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 20:19:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 20:19:59.452150 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-a3e4d916-8885-43ed-a03f-7166fcb8e088 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:19:59.452794 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-a3e4d916-8885-43ed-a03f-7166fcb8e088 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] [instance: 3220536d-878a-4fd9-ab58-15a5c060f6e0] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:19:59.459309 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-a3e4d916-8885-43ed-a03f-7166fcb8e088 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:19:59.459753 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-a3e4d916-8885-43ed-a03f-7166fcb8e088 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:19:59.460509 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-a3e4d916-8885-43ed-a03f-7166fcb8e088 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:19:59.461038 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-a3e4d916-8885-43ed-a03f-7166fcb8e088 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:19:59.474319 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.wsgi [None req-a3e4d916-8885-43ed-a03f-7166fcb8e088 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] HTTP exception thrown: Instance 3220536d-878a-4fd9-ab58-15a5c060f6e0 could not be found. Jul 21 20:19:59.475965 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-a3e4d916-8885-43ed-a03f-7166fcb8e088 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Request method failure captured: Jul 21 20:19:59.475965 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: request: GET /compute/v2.1/servers/3220536d-878a-4fd9-ab58-15a5c060f6e0 HTTP/1.1 Jul 21 20:19:59.475965 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Accept: application/json Jul 21 20:19:59.475965 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Accept-Encoding: identity Jul 21 20:19:59.475965 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Connection: close Jul 21 20:19:59.475965 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Content-Length: 0 Jul 21 20:19:59.475965 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Content-Type: application/json Jul 21 20:19:59.475965 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Host: 10.222.0.58 Jul 21 20:19:59.475965 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Openstack-System-Scope: None Jul 21 20:19:59.475965 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: User-Agent: python-urllib3/1.26.9 Jul 21 20:19:59.475965 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Auth-Token: gAAAAABi2bSlc1LtntMsCZpwqE1WWVV804sW-WCyKTxzSfvh_4MXRAa3PJzz4D55YRfBqX6F3-p1i3RgonXzH4OrV35OzFbbZRKm_pUXJIbNcYoBMytmms2EnJQL0A4XaC45HQmI92pVUwRnjrm5GweJkKMzoxX3UlYCDi1TEhgtgI7h_3dbfWg Jul 21 20:19:59.475965 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Domain-Id: None Jul 21 20:19:59.475965 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Domain-Name: None Jul 21 20:19:59.475965 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Identity-Status: Confirmed Jul 21 20:19:59.475965 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Is-Admin-Project: True Jul 21 20:19:59.475965 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Domain-Id: default Jul 21 20:19:59.475965 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Domain-Name: Default Jul 21 20:19:59.475965 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Id: fc37aee55036430bb0627cdc2cd61011 Jul 21 20:19:59.475965 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Name: tempest-VolumesSnapshotTestJSON-846639818 Jul 21 20:19:59.475965 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Role: reader,member Jul 21 20:19:59.475965 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Roles: reader,member Jul 21 20:19:59.477633 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fc37aee55036430bb0627cdc2cd61011"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fc37aee55036430bb0627cdc2cd61011"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fc37aee55036430bb0627cdc2cd61011"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fc37aee55036430bb0627cdc2cd61011"}]}] Jul 21 20:19:59.477633 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Tenant: tempest-VolumesSnapshotTestJSON-846639818 Jul 21 20:19:59.477633 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Tenant-Id: fc37aee55036430bb0627cdc2cd61011 Jul 21 20:19:59.477633 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-846639818 Jul 21 20:19:59.477633 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User: tempest-VolumesSnapshotTestJSON-846639818-project Jul 21 20:19:59.477633 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Domain-Id: default Jul 21 20:19:59.477633 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Domain-Name: Default Jul 21 20:19:59.477633 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Id: 522e94fb0637414a9ceb96f3b8aa3003 Jul 21 20:19:59.477633 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Name: tempest-VolumesSnapshotTestJSON-846639818-project Jul 21 20:19:59.477633 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: method: > Jul 21 20:19:59.477633 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: exception: Instance 3220536d-878a-4fd9-ab58-15a5c060f6e0 could not be found. Jul 21 20:19:59.477633 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: action_args: {'id': '3220536d-878a-4fd9-ab58-15a5c060f6e0'} Jul 21 20:19:59.478527 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 20:19:59.478527 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:19:59.478527 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 20:19:59.478527 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 20:19:59.478527 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 20:19:59.478527 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 20:19:59.478527 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 20:19:59.478527 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 20:19:59.478527 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 20:19:59.478527 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 20:19:59.478527 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3220536d-878a-4fd9-ab58-15a5c060f6e0 could not be found. Jul 21 20:19:59.478527 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:19:59.478527 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:19:59.478527 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:19:59.478527 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:19:59.478527 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:19:59.478527 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:19:59.478527 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 20:19:59.478527 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 20:19:59.478527 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 20:19:59.480769 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 20:19:59.480769 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 20:19:59.480769 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 20:19:59.480769 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 20:19:59.480769 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 20:19:59.480769 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 20:19:59.480769 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 20:19:59.480769 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3220536d-878a-4fd9-ab58-15a5c060f6e0 could not be found. Jul 21 20:19:59.480769 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:19:59.480769 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:19:59.480769 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:19:59.480769 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:19:59.480769 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:19:59.480769 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:19:59.480769 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 20:19:59.480769 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 20:19:59.480769 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3220536d-878a-4fd9-ab58-15a5c060f6e0 could not be found. Jul 21 20:19:59.480769 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:19:59.482133 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-a3e4d916-8885-43ed-a03f-7166fcb8e088 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Returning 404 to user: Instance 3220536d-878a-4fd9-ab58-15a5c060f6e0 could not be found. {{(pid=118344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 20:19:59.482133 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-a3e4d916-8885-43ed-a03f-7166fcb8e088 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] 10.222.0.58 "GET /compute/v2.1/servers/3220536d-878a-4fd9-ab58-15a5c060f6e0" status: 404 len: 111 microversion: 2.1 time: 0.029129 Jul 21 20:19:59.482133 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 588/1195] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:19:59 2022] GET /compute/v2.1/servers/3220536d-878a-4fd9-ab58-15a5c060f6e0 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 20:20:08.120337 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-7013453d-cdb8-4ee0-bda6-df7b40c0f58d tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:20:08.121364 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-7013453d-cdb8-4ee0-bda6-df7b40c0f58d tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] [instance: 25c00062-b8e5-4575-a993-bcace67b3682] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:20:08.128314 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-7013453d-cdb8-4ee0-bda6-df7b40c0f58d tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:20:08.128761 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-7013453d-cdb8-4ee0-bda6-df7b40c0f58d tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:20:08.129524 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-7013453d-cdb8-4ee0-bda6-df7b40c0f58d tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:20:08.129965 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-7013453d-cdb8-4ee0-bda6-df7b40c0f58d tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:20:08.302938 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-7013453d-cdb8-4ee0-bda6-df7b40c0f58d tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] 10.222.0.58 "POST /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682/action" status: 202 len: 0 microversion: 2.1 time: 0.186472 Jul 21 20:20:08.303569 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 608/1196] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Jul 21 20:20:08 2022] POST /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682/action => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 20:20:08.312343 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-a280264b-7d63-4f06-aff6-e7dc0772770f tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:20:08.313050 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-a280264b-7d63-4f06-aff6-e7dc0772770f tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] [instance: 25c00062-b8e5-4575-a993-bcace67b3682] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:20:08.319641 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-a280264b-7d63-4f06-aff6-e7dc0772770f tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:20:08.322486 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-a280264b-7d63-4f06-aff6-e7dc0772770f tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:20:08.322486 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-a280264b-7d63-4f06-aff6-e7dc0772770f tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:20:08.322486 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-a280264b-7d63-4f06-aff6-e7dc0772770f tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:20:08.465383 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-a280264b-7d63-4f06-aff6-e7dc0772770f tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216eb0b454534a878c30a23e9126ff9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c262cd918784d6490dcd78eda61c551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:20:08.474747 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-a280264b-7d63-4f06-aff6-e7dc0772770f tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] 10.222.0.58 "GET /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682" status: 200 len: 1750 microversion: 2.1 time: 0.166490 Jul 21 20:20:08.475555 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 589/1197] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:20:08 2022] GET /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682 => generated 1750 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:20:09.493225 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-d237cf44-29c2-483d-811a-bed7ae85dcb7 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:20:09.493930 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-d237cf44-29c2-483d-811a-bed7ae85dcb7 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] [instance: 25c00062-b8e5-4575-a993-bcace67b3682] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:20:09.500146 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d237cf44-29c2-483d-811a-bed7ae85dcb7 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:20:09.500590 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d237cf44-29c2-483d-811a-bed7ae85dcb7 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:20:09.501352 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d237cf44-29c2-483d-811a-bed7ae85dcb7 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:20:09.501784 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d237cf44-29c2-483d-811a-bed7ae85dcb7 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:20:09.646676 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-d237cf44-29c2-483d-811a-bed7ae85dcb7 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216eb0b454534a878c30a23e9126ff9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c262cd918784d6490dcd78eda61c551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:20:09.654509 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-d237cf44-29c2-483d-811a-bed7ae85dcb7 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] 10.222.0.58 "GET /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682" status: 200 len: 1750 microversion: 2.1 time: 0.166037 Jul 21 20:20:09.655080 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 609/1198] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:20:09 2022] GET /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682 => generated 1750 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:20:10.672846 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-8b92ea7f-71e3-45f4-b765-bbd4ef9bb9fb tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:20:10.673447 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-8b92ea7f-71e3-45f4-b765-bbd4ef9bb9fb tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] [instance: 25c00062-b8e5-4575-a993-bcace67b3682] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:20:10.680715 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-8b92ea7f-71e3-45f4-b765-bbd4ef9bb9fb tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:20:10.681165 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-8b92ea7f-71e3-45f4-b765-bbd4ef9bb9fb tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:20:10.682452 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-8b92ea7f-71e3-45f4-b765-bbd4ef9bb9fb tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:20:10.682452 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-8b92ea7f-71e3-45f4-b765-bbd4ef9bb9fb tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:20:11.091471 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-8b92ea7f-71e3-45f4-b765-bbd4ef9bb9fb tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216eb0b454534a878c30a23e9126ff9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c262cd918784d6490dcd78eda61c551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:20:11.103928 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-8b92ea7f-71e3-45f4-b765-bbd4ef9bb9fb tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] 10.222.0.58 "GET /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682" status: 200 len: 1750 microversion: 2.1 time: 0.435173 Jul 21 20:20:11.104522 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 590/1199] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:20:10 2022] GET /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682 => generated 1750 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:20:11.805322 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-e252b4ab-e2f9-4132-a6e2-690ff80a512f tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-286592671", "imageRef": "357a1479-6cbd-4882-8d3f-d945fa40e6df", "flavorRef": "452", "networks": [{"uuid": "eba7847f-38f7-4524-be74-2836b06a25d5"}]}} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:20:11.856432 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.network.neutron [None req-e252b4ab-e2f9-4132-a6e2-690ff80a512f tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] validate_networks() for [('eba7847f-38f7-4524-be74-2836b06a25d5', None, None, None, None, None)] {{(pid=118345) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 20:20:12.120955 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-f8c4dab9-7be7-4805-98bc-f255f724f7a8 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:20:12.121561 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-f8c4dab9-7be7-4805-98bc-f255f724f7a8 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] [instance: 25c00062-b8e5-4575-a993-bcace67b3682] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:20:12.128584 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f8c4dab9-7be7-4805-98bc-f255f724f7a8 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:20:12.129023 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f8c4dab9-7be7-4805-98bc-f255f724f7a8 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:20:12.129782 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f8c4dab9-7be7-4805-98bc-f255f724f7a8 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:20:12.130213 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f8c4dab9-7be7-4805-98bc-f255f724f7a8 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:20:12.199049 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-e252b4ab-e2f9-4132-a6e2-690ff80a512f tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Flavor limits 0:0:0 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 20:20:12.199508 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-e252b4ab-e2f9-4132-a6e2-690ff80a512f tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Image limits 0:0:0 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 20:20:12.199982 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-e252b4ab-e2f9-4132-a6e2-690ff80a512f tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Flavor pref 0:0:0 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 20:20:12.200514 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-e252b4ab-e2f9-4132-a6e2-690ff80a512f tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Image pref 0:0:0 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 20:20:12.200929 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-e252b4ab-e2f9-4132-a6e2-690ff80a512f tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 20:20:12.210397 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e252b4ab-e2f9-4132-a6e2-690ff80a512f tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:20:12.211395 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e252b4ab-e2f9-4132-a6e2-690ff80a512f tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:20:12.211666 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e252b4ab-e2f9-4132-a6e2-690ff80a512f tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:20:12.212101 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e252b4ab-e2f9-4132-a6e2-690ff80a512f tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:20:12.229037 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.quota [None req-e252b4ab-e2f9-4132-a6e2-690ff80a512f tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Getting quotas for project fc37aee55036430bb0627cdc2cd61011. Resources: {'instances', 'cores', 'ram'} {{(pid=118345) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 20:20:12.232967 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.quota [None req-e252b4ab-e2f9-4132-a6e2-690ff80a512f tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Getting quotas for user 522e94fb0637414a9ceb96f3b8aa3003 and project fc37aee55036430bb0627cdc2cd61011. Resources: {'instances', 'cores', 'ram'} {{(pid=118345) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 20:20:12.245885 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-e252b4ab-e2f9-4132-a6e2-690ff80a512f tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Going to run 1 instances... {{(pid=118345) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 20:20:12.248187 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-e252b4ab-e2f9-4132-a6e2-690ff80a512f tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] [instance: b83383fe-a2d7-44e6-ad63-b19b6861adf1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='357a1479-6cbd-4882-8d3f-d945fa40e6df',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118345) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 20:20:12.277823 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-f8c4dab9-7be7-4805-98bc-f255f724f7a8 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216eb0b454534a878c30a23e9126ff9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c262cd918784d6490dcd78eda61c551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:20:12.285931 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-f8c4dab9-7be7-4805-98bc-f255f724f7a8 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] 10.222.0.58 "GET /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682" status: 200 len: 1755 microversion: 2.1 time: 0.168953 Jul 21 20:20:12.290212 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 591/1200] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:20:12 2022] GET /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682 => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:20:12.386781 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-e252b4ab-e2f9-4132-a6e2-690ff80a512f tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.585268 Jul 21 20:20:12.387648 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 610/1201] 10.222.0.58 () {60 vars in 1146 bytes} [Thu Jul 21 20:20:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 587 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 20:20:12.397554 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-e4210bca-77a7-4b9a-b93d-d870eab13ed8 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:20:12.398113 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-e4210bca-77a7-4b9a-b93d-d870eab13ed8 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] [instance: b83383fe-a2d7-44e6-ad63-b19b6861adf1] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:20:12.454180 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-e4210bca-77a7-4b9a-b93d-d870eab13ed8 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522e94fb0637414a9ceb96f3b8aa3003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc37aee55036430bb0627cdc2cd61011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:20:12.460833 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-e4210bca-77a7-4b9a-b93d-d870eab13ed8 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] 10.222.0.58 "GET /compute/v2.1/servers/b83383fe-a2d7-44e6-ad63-b19b6861adf1" status: 200 len: 1218 microversion: 2.1 time: 0.067233 Jul 21 20:20:12.461450 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 592/1202] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:20:12 2022] GET /compute/v2.1/servers/b83383fe-a2d7-44e6-ad63-b19b6861adf1 => generated 1218 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:20:13.305223 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-41b02a3e-39a6-4268-a3c5-baba649335bd tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:20:13.305809 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-41b02a3e-39a6-4268-a3c5-baba649335bd tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] [instance: 25c00062-b8e5-4575-a993-bcace67b3682] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:20:13.312511 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-41b02a3e-39a6-4268-a3c5-baba649335bd tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:20:13.312948 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-41b02a3e-39a6-4268-a3c5-baba649335bd tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:20:13.313779 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-41b02a3e-39a6-4268-a3c5-baba649335bd tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:20:13.314181 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-41b02a3e-39a6-4268-a3c5-baba649335bd tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:20:13.461702 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-41b02a3e-39a6-4268-a3c5-baba649335bd tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216eb0b454534a878c30a23e9126ff9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c262cd918784d6490dcd78eda61c551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:20:13.470088 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-41b02a3e-39a6-4268-a3c5-baba649335bd tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] 10.222.0.58 "GET /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682" status: 200 len: 1755 microversion: 2.1 time: 0.169484 Jul 21 20:20:13.470646 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 611/1203] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:20:13 2022] GET /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682 => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:20:13.478215 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-007da7bd-10fc-4039-a1cc-76f5788feb05 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:20:13.478824 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-007da7bd-10fc-4039-a1cc-76f5788feb05 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] [instance: b83383fe-a2d7-44e6-ad63-b19b6861adf1] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:20:13.485338 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-007da7bd-10fc-4039-a1cc-76f5788feb05 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:20:13.485783 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-007da7bd-10fc-4039-a1cc-76f5788feb05 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:20:13.486539 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-007da7bd-10fc-4039-a1cc-76f5788feb05 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:20:13.486970 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-007da7bd-10fc-4039-a1cc-76f5788feb05 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:20:13.548931 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-007da7bd-10fc-4039-a1cc-76f5788feb05 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522e94fb0637414a9ceb96f3b8aa3003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc37aee55036430bb0627cdc2cd61011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:20:13.557119 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-007da7bd-10fc-4039-a1cc-76f5788feb05 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] 10.222.0.58 "GET /compute/v2.1/servers/b83383fe-a2d7-44e6-ad63-b19b6861adf1" status: 200 len: 1214 microversion: 2.1 time: 0.082928 Jul 21 20:20:13.557680 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 593/1204] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:20:13 2022] GET /compute/v2.1/servers/b83383fe-a2d7-44e6-ad63-b19b6861adf1 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:20:14.487542 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-024843b7-fb44-450a-a7a9-b7d29ec19e71 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:20:14.488150 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-024843b7-fb44-450a-a7a9-b7d29ec19e71 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] [instance: 25c00062-b8e5-4575-a993-bcace67b3682] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:20:14.494662 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-024843b7-fb44-450a-a7a9-b7d29ec19e71 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:20:14.495138 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-024843b7-fb44-450a-a7a9-b7d29ec19e71 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:20:14.496408 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-024843b7-fb44-450a-a7a9-b7d29ec19e71 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:20:14.496535 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-024843b7-fb44-450a-a7a9-b7d29ec19e71 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:20:14.574580 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-e5002e04-7827-408a-beb8-2e4ebda5dad9 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:20:14.575948 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-e5002e04-7827-408a-beb8-2e4ebda5dad9 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] [instance: b83383fe-a2d7-44e6-ad63-b19b6861adf1] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:20:14.582513 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-e5002e04-7827-408a-beb8-2e4ebda5dad9 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:20:14.582954 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-e5002e04-7827-408a-beb8-2e4ebda5dad9 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:20:14.583946 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-e5002e04-7827-408a-beb8-2e4ebda5dad9 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:20:14.584381 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-e5002e04-7827-408a-beb8-2e4ebda5dad9 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:20:14.654814 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-024843b7-fb44-450a-a7a9-b7d29ec19e71 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216eb0b454534a878c30a23e9126ff9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c262cd918784d6490dcd78eda61c551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:20:14.663178 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-024843b7-fb44-450a-a7a9-b7d29ec19e71 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] 10.222.0.58 "GET /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682" status: 200 len: 1755 microversion: 2.1 time: 0.179764 Jul 21 20:20:14.663752 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 612/1205] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:20:14 2022] GET /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682 => generated 1755 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:20:14.678142 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-e5002e04-7827-408a-beb8-2e4ebda5dad9 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522e94fb0637414a9ceb96f3b8aa3003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc37aee55036430bb0627cdc2cd61011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:20:14.685597 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-e5002e04-7827-408a-beb8-2e4ebda5dad9 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] 10.222.0.58 "GET /compute/v2.1/servers/b83383fe-a2d7-44e6-ad63-b19b6861adf1" status: 200 len: 1276 microversion: 2.1 time: 0.115234 Jul 21 20:20:14.686157 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 594/1206] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:20:14 2022] GET /compute/v2.1/servers/b83383fe-a2d7-44e6-ad63-b19b6861adf1 => generated 1276 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:20:15.680205 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-42018476-0605-4584-96ba-3241f5b6eac8 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:20:15.680814 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-42018476-0605-4584-96ba-3241f5b6eac8 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] [instance: 25c00062-b8e5-4575-a993-bcace67b3682] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:20:15.687249 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-42018476-0605-4584-96ba-3241f5b6eac8 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:20:15.687698 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-42018476-0605-4584-96ba-3241f5b6eac8 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:20:15.688588 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-42018476-0605-4584-96ba-3241f5b6eac8 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:20:15.688886 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-42018476-0605-4584-96ba-3241f5b6eac8 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:20:15.703289 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-21b00766-8d9d-481e-aed5-34deed1cda9f tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:20:15.704601 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-21b00766-8d9d-481e-aed5-34deed1cda9f tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] [instance: b83383fe-a2d7-44e6-ad63-b19b6861adf1] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:20:15.712243 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-21b00766-8d9d-481e-aed5-34deed1cda9f tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:20:15.712922 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-21b00766-8d9d-481e-aed5-34deed1cda9f tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:20:15.717366 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-21b00766-8d9d-481e-aed5-34deed1cda9f tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:20:15.717366 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-21b00766-8d9d-481e-aed5-34deed1cda9f tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:20:15.848694 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-42018476-0605-4584-96ba-3241f5b6eac8 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216eb0b454534a878c30a23e9126ff9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c262cd918784d6490dcd78eda61c551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:20:15.857942 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-42018476-0605-4584-96ba-3241f5b6eac8 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] 10.222.0.58 "GET /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682" status: 200 len: 1755 microversion: 2.1 time: 0.181573 Jul 21 20:20:15.858517 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 613/1207] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:20:15 2022] GET /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682 => generated 1755 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:20:15.863244 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [req-389570af-c918-46eb-b20f-528a7008e0fb req-6add779c-b9b4-4f38-83c6-5683c4dcf230 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b83383fe-a2d7-44e6-ad63-b19b6861adf1", "tag": "195f2b31-989a-49e2-bee1-fd2dc7392373"}]} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:20:15.871421 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-389570af-c918-46eb-b20f-528a7008e0fb req-6add779c-b9b4-4f38-83c6-5683c4dcf230 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:20:15.871820 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-389570af-c918-46eb-b20f-528a7008e0fb req-6add779c-b9b4-4f38-83c6-5683c4dcf230 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:20:15.873752 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-21b00766-8d9d-481e-aed5-34deed1cda9f tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522e94fb0637414a9ceb96f3b8aa3003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc37aee55036430bb0627cdc2cd61011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:20:15.882726 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-21b00766-8d9d-481e-aed5-34deed1cda9f tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] 10.222.0.58 "GET /compute/v2.1/servers/b83383fe-a2d7-44e6-ad63-b19b6861adf1" status: 200 len: 1318 microversion: 2.1 time: 0.183523 Jul 21 20:20:15.883635 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 595/1208] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:20:15 2022] GET /compute/v2.1/servers/b83383fe-a2d7-44e6-ad63-b19b6861adf1 => generated 1318 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:20:15.894384 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.compute.server_external_events [req-389570af-c918-46eb-b20f-528a7008e0fb req-6add779c-b9b4-4f38-83c6-5683c4dcf230 service nova] Creating event network-changed:195f2b31-989a-49e2-bee1-fd2dc7392373 for instance b83383fe-a2d7-44e6-ad63-b19b6861adf1 on hv-cinder-85054 Jul 21 20:20:15.899231 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [req-389570af-c918-46eb-b20f-528a7008e0fb req-6add779c-b9b4-4f38-83c6-5683c4dcf230 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039550 Jul 21 20:20:15.899862 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 614/1209] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 20:20:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:20:16.875054 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-8b6f4676-0898-4fd8-b21b-9349794d4607 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:20:16.875674 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-8b6f4676-0898-4fd8-b21b-9349794d4607 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] [instance: 25c00062-b8e5-4575-a993-bcace67b3682] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:20:16.882160 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-8b6f4676-0898-4fd8-b21b-9349794d4607 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:20:16.882607 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-8b6f4676-0898-4fd8-b21b-9349794d4607 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:20:16.883403 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-8b6f4676-0898-4fd8-b21b-9349794d4607 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:20:16.883838 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-8b6f4676-0898-4fd8-b21b-9349794d4607 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:20:16.901132 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-9de7a34c-96b3-42f4-a6e8-450dca882467 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:20:16.901838 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-9de7a34c-96b3-42f4-a6e8-450dca882467 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] [instance: b83383fe-a2d7-44e6-ad63-b19b6861adf1] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:20:16.908452 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-9de7a34c-96b3-42f4-a6e8-450dca882467 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:20:16.908900 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-9de7a34c-96b3-42f4-a6e8-450dca882467 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:20:16.909812 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-9de7a34c-96b3-42f4-a6e8-450dca882467 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:20:16.910248 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-9de7a34c-96b3-42f4-a6e8-450dca882467 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:20:17.029347 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-8b6f4676-0898-4fd8-b21b-9349794d4607 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216eb0b454534a878c30a23e9126ff9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c262cd918784d6490dcd78eda61c551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:20:17.038534 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-8b6f4676-0898-4fd8-b21b-9349794d4607 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] 10.222.0.58 "GET /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682" status: 200 len: 1755 microversion: 2.1 time: 0.167399 Jul 21 20:20:17.039126 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 596/1210] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:20:16 2022] GET /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682 => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:20:17.046664 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-9de7a34c-96b3-42f4-a6e8-450dca882467 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522e94fb0637414a9ceb96f3b8aa3003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc37aee55036430bb0627cdc2cd61011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:20:17.055676 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-9de7a34c-96b3-42f4-a6e8-450dca882467 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] 10.222.0.58 "GET /compute/v2.1/servers/b83383fe-a2d7-44e6-ad63-b19b6861adf1" status: 200 len: 1318 microversion: 2.1 time: 0.158697 Jul 21 20:20:17.056405 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 615/1211] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:20:16 2022] GET /compute/v2.1/servers/b83383fe-a2d7-44e6-ad63-b19b6861adf1 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:20:18.056424 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-f7f71796-b10c-42cf-96ce-f6720a88c51d tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:20:18.056988 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-f7f71796-b10c-42cf-96ce-f6720a88c51d tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] [instance: 25c00062-b8e5-4575-a993-bcace67b3682] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:20:18.063458 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f7f71796-b10c-42cf-96ce-f6720a88c51d tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:20:18.063904 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f7f71796-b10c-42cf-96ce-f6720a88c51d tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:20:18.064666 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f7f71796-b10c-42cf-96ce-f6720a88c51d tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:20:18.065096 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f7f71796-b10c-42cf-96ce-f6720a88c51d tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:20:18.073133 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-40e178fd-c7d8-41e2-8b1e-eab916452a6f tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:20:18.073745 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-40e178fd-c7d8-41e2-8b1e-eab916452a6f tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] [instance: b83383fe-a2d7-44e6-ad63-b19b6861adf1] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:20:18.080190 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-40e178fd-c7d8-41e2-8b1e-eab916452a6f tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:20:18.080635 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-40e178fd-c7d8-41e2-8b1e-eab916452a6f tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:20:18.081399 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-40e178fd-c7d8-41e2-8b1e-eab916452a6f tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:20:18.081839 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-40e178fd-c7d8-41e2-8b1e-eab916452a6f tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:20:18.210717 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-f7f71796-b10c-42cf-96ce-f6720a88c51d tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216eb0b454534a878c30a23e9126ff9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c262cd918784d6490dcd78eda61c551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:20:18.216735 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-40e178fd-c7d8-41e2-8b1e-eab916452a6f tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522e94fb0637414a9ceb96f3b8aa3003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc37aee55036430bb0627cdc2cd61011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:20:18.218804 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-f7f71796-b10c-42cf-96ce-f6720a88c51d tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] 10.222.0.58 "GET /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682" status: 200 len: 1755 microversion: 2.1 time: 0.166383 Jul 21 20:20:18.219404 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 597/1212] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:20:18 2022] GET /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682 => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:20:18.224837 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-40e178fd-c7d8-41e2-8b1e-eab916452a6f tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] 10.222.0.58 "GET /compute/v2.1/servers/b83383fe-a2d7-44e6-ad63-b19b6861adf1" status: 200 len: 1318 microversion: 2.1 time: 0.155565 Jul 21 20:20:18.225389 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 616/1213] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:20:18 2022] GET /compute/v2.1/servers/b83383fe-a2d7-44e6-ad63-b19b6861adf1 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:20:19.237153 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-1d00def0-27fd-48a6-adc2-0e7156b194d8 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:20:19.237680 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-1d00def0-27fd-48a6-adc2-0e7156b194d8 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] [instance: 25c00062-b8e5-4575-a993-bcace67b3682] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:20:19.241842 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-cd087fb3-a38e-499f-8a47-04d9ca5b2696 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:20:19.242452 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-cd087fb3-a38e-499f-8a47-04d9ca5b2696 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] [instance: b83383fe-a2d7-44e6-ad63-b19b6861adf1] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:20:19.244862 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-1d00def0-27fd-48a6-adc2-0e7156b194d8 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:20:19.245314 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-1d00def0-27fd-48a6-adc2-0e7156b194d8 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:20:19.246076 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-1d00def0-27fd-48a6-adc2-0e7156b194d8 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:20:19.246713 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-1d00def0-27fd-48a6-adc2-0e7156b194d8 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:20:19.248972 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-cd087fb3-a38e-499f-8a47-04d9ca5b2696 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:20:19.249419 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-cd087fb3-a38e-499f-8a47-04d9ca5b2696 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:20:19.250189 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-cd087fb3-a38e-499f-8a47-04d9ca5b2696 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:20:19.250624 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-cd087fb3-a38e-499f-8a47-04d9ca5b2696 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:20:19.380939 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-cd087fb3-a38e-499f-8a47-04d9ca5b2696 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522e94fb0637414a9ceb96f3b8aa3003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc37aee55036430bb0627cdc2cd61011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:20:19.388591 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-cd087fb3-a38e-499f-8a47-04d9ca5b2696 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] 10.222.0.58 "GET /compute/v2.1/servers/b83383fe-a2d7-44e6-ad63-b19b6861adf1" status: 200 len: 1318 microversion: 2.1 time: 0.151046 Jul 21 20:20:19.389174 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 617/1214] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:20:19 2022] GET /compute/v2.1/servers/b83383fe-a2d7-44e6-ad63-b19b6861adf1 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:20:19.389885 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-1d00def0-27fd-48a6-adc2-0e7156b194d8 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216eb0b454534a878c30a23e9126ff9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c262cd918784d6490dcd78eda61c551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:20:19.398166 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-1d00def0-27fd-48a6-adc2-0e7156b194d8 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] 10.222.0.58 "GET /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682" status: 200 len: 1755 microversion: 2.1 time: 0.165037 Jul 21 20:20:19.398788 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 598/1215] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:20:19 2022] GET /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682 => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:20:20.406287 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-be12443c-b465-4454-bdf3-5eab0520351c tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:20:20.406897 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-be12443c-b465-4454-bdf3-5eab0520351c tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] [instance: b83383fe-a2d7-44e6-ad63-b19b6861adf1] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:20:20.413648 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-be12443c-b465-4454-bdf3-5eab0520351c tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:20:20.414091 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-be12443c-b465-4454-bdf3-5eab0520351c tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:20:20.414216 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-8ffafb42-e9cf-448d-944f-403f640ac21b tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:20:20.414707 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-8ffafb42-e9cf-448d-944f-403f640ac21b tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] [instance: 25c00062-b8e5-4575-a993-bcace67b3682] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:20:20.414865 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-be12443c-b465-4454-bdf3-5eab0520351c tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:20:20.415324 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-be12443c-b465-4454-bdf3-5eab0520351c tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:20:20.421119 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-8ffafb42-e9cf-448d-944f-403f640ac21b tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:20:20.421646 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-8ffafb42-e9cf-448d-944f-403f640ac21b tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:20:20.422416 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-8ffafb42-e9cf-448d-944f-403f640ac21b tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:20:20.422851 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-8ffafb42-e9cf-448d-944f-403f640ac21b tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:20:20.561974 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-be12443c-b465-4454-bdf3-5eab0520351c tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522e94fb0637414a9ceb96f3b8aa3003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc37aee55036430bb0627cdc2cd61011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:20:20.570472 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-be12443c-b465-4454-bdf3-5eab0520351c tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] 10.222.0.58 "GET /compute/v2.1/servers/b83383fe-a2d7-44e6-ad63-b19b6861adf1" status: 200 len: 1318 microversion: 2.1 time: 0.168036 Jul 21 20:20:20.571055 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 618/1216] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:20:20 2022] GET /compute/v2.1/servers/b83383fe-a2d7-44e6-ad63-b19b6861adf1 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:20:20.579786 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-8ffafb42-e9cf-448d-944f-403f640ac21b tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216eb0b454534a878c30a23e9126ff9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c262cd918784d6490dcd78eda61c551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:20:20.587819 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-8ffafb42-e9cf-448d-944f-403f640ac21b tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] 10.222.0.58 "GET /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682" status: 200 len: 1755 microversion: 2.1 time: 0.177535 Jul 21 20:20:20.588377 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 599/1217] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:20:20 2022] GET /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682 => generated 1755 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:20:21.587766 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-0db0f8df-98a0-439d-a2bb-53547725d5cf tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:20:21.588379 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-0db0f8df-98a0-439d-a2bb-53547725d5cf tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] [instance: b83383fe-a2d7-44e6-ad63-b19b6861adf1] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:20:21.594861 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0db0f8df-98a0-439d-a2bb-53547725d5cf tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:20:21.595343 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0db0f8df-98a0-439d-a2bb-53547725d5cf tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:20:21.596361 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0db0f8df-98a0-439d-a2bb-53547725d5cf tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:20:21.596793 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0db0f8df-98a0-439d-a2bb-53547725d5cf tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:20:21.605226 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-9e091b0c-3df8-4888-8161-d8b2ee0eed49 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:20:21.605834 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-9e091b0c-3df8-4888-8161-d8b2ee0eed49 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] [instance: 25c00062-b8e5-4575-a993-bcace67b3682] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:20:21.612282 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-9e091b0c-3df8-4888-8161-d8b2ee0eed49 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:20:21.612730 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-9e091b0c-3df8-4888-8161-d8b2ee0eed49 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:20:21.613555 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-9e091b0c-3df8-4888-8161-d8b2ee0eed49 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:20:21.613985 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-9e091b0c-3df8-4888-8161-d8b2ee0eed49 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:20:21.730560 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-0db0f8df-98a0-439d-a2bb-53547725d5cf tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522e94fb0637414a9ceb96f3b8aa3003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc37aee55036430bb0627cdc2cd61011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:20:21.738472 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-0db0f8df-98a0-439d-a2bb-53547725d5cf tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] 10.222.0.58 "GET /compute/v2.1/servers/b83383fe-a2d7-44e6-ad63-b19b6861adf1" status: 200 len: 1318 microversion: 2.1 time: 0.154495 Jul 21 20:20:21.739061 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 619/1218] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:20:21 2022] GET /compute/v2.1/servers/b83383fe-a2d7-44e6-ad63-b19b6861adf1 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:20:21.760224 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-9e091b0c-3df8-4888-8161-d8b2ee0eed49 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216eb0b454534a878c30a23e9126ff9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c262cd918784d6490dcd78eda61c551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:20:21.768463 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-9e091b0c-3df8-4888-8161-d8b2ee0eed49 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] 10.222.0.58 "GET /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682" status: 200 len: 1755 microversion: 2.1 time: 0.167119 Jul 21 20:20:21.769020 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 600/1219] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:20:21 2022] GET /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682 => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:20:21.939569 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [req-f907eb1a-cca7-433c-8580-70c3a5ee911a req-7017bbb8-e2bd-47ae-89a7-2bbf6e343d02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b83383fe-a2d7-44e6-ad63-b19b6861adf1", "name": "network-vif-plugged", "status": "completed", "tag": "195f2b31-989a-49e2-bee1-fd2dc7392373"}]} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:20:21.948022 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-f907eb1a-cca7-433c-8580-70c3a5ee911a req-7017bbb8-e2bd-47ae-89a7-2bbf6e343d02 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:20:21.948469 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-f907eb1a-cca7-433c-8580-70c3a5ee911a req-7017bbb8-e2bd-47ae-89a7-2bbf6e343d02 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:20:21.959519 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.compute.server_external_events [req-f907eb1a-cca7-433c-8580-70c3a5ee911a req-7017bbb8-e2bd-47ae-89a7-2bbf6e343d02 service nova] Creating event network-vif-plugged:195f2b31-989a-49e2-bee1-fd2dc7392373 for instance b83383fe-a2d7-44e6-ad63-b19b6861adf1 on hv-cinder-85054 Jul 21 20:20:21.964261 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [req-f907eb1a-cca7-433c-8580-70c3a5ee911a req-7017bbb8-e2bd-47ae-89a7-2bbf6e343d02 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028558 Jul 21 20:20:21.964826 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 620/1220] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 20:20:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:20:22.755320 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-084a8a2f-7f21-4f16-9902-a82eb2ce4ae9 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:20:22.755941 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-084a8a2f-7f21-4f16-9902-a82eb2ce4ae9 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] [instance: b83383fe-a2d7-44e6-ad63-b19b6861adf1] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:20:22.757885 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG dbcounter [-] [118344] Writing DB stats nova_cell0:SELECT=2 {{(pid=118344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:20:22.763207 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-084a8a2f-7f21-4f16-9902-a82eb2ce4ae9 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:20:22.769932 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-084a8a2f-7f21-4f16-9902-a82eb2ce4ae9 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:20:22.769932 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-084a8a2f-7f21-4f16-9902-a82eb2ce4ae9 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:20:22.769932 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-084a8a2f-7f21-4f16-9902-a82eb2ce4ae9 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:20:22.782884 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell0:SELECT=2 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:20:22.783818 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell0:SELECT=6 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:20:22.788971 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-bb6cdc69-8799-4641-8013-afefef9e9732 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:20:22.789663 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-bb6cdc69-8799-4641-8013-afefef9e9732 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] [instance: 25c00062-b8e5-4575-a993-bcace67b3682] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:20:22.796062 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-bb6cdc69-8799-4641-8013-afefef9e9732 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:20:22.796547 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-bb6cdc69-8799-4641-8013-afefef9e9732 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:20:22.797333 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-bb6cdc69-8799-4641-8013-afefef9e9732 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:20:22.797762 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-bb6cdc69-8799-4641-8013-afefef9e9732 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:20:22.815865 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:20:22.904645 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-084a8a2f-7f21-4f16-9902-a82eb2ce4ae9 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522e94fb0637414a9ceb96f3b8aa3003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc37aee55036430bb0627cdc2cd61011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:20:22.913175 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-084a8a2f-7f21-4f16-9902-a82eb2ce4ae9 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] 10.222.0.58 "GET /compute/v2.1/servers/b83383fe-a2d7-44e6-ad63-b19b6861adf1" status: 200 len: 1318 microversion: 2.1 time: 0.161720 Jul 21 20:20:22.913928 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 601/1221] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:20:22 2022] GET /compute/v2.1/servers/b83383fe-a2d7-44e6-ad63-b19b6861adf1 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:20:22.946641 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-bb6cdc69-8799-4641-8013-afefef9e9732 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216eb0b454534a878c30a23e9126ff9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c262cd918784d6490dcd78eda61c551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:20:22.954495 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-bb6cdc69-8799-4641-8013-afefef9e9732 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] 10.222.0.58 "GET /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682" status: 200 len: 1755 microversion: 2.1 time: 0.172627 Jul 21 20:20:22.957382 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 621/1222] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:20:22 2022] GET /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682 => generated 1755 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:20:23.930367 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-b0ffaa15-0604-4670-a111-b18d2c7e51a9 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:20:23.930971 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-b0ffaa15-0604-4670-a111-b18d2c7e51a9 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] [instance: b83383fe-a2d7-44e6-ad63-b19b6861adf1] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:20:23.933328 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG dbcounter [-] [118344] Writing DB stats nova_api:SELECT=37 {{(pid=118344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:20:23.938048 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-b0ffaa15-0604-4670-a111-b18d2c7e51a9 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:20:23.938496 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-b0ffaa15-0604-4670-a111-b18d2c7e51a9 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:20:23.939288 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-b0ffaa15-0604-4670-a111-b18d2c7e51a9 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:20:23.939728 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-b0ffaa15-0604-4670-a111-b18d2c7e51a9 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:20:23.944142 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG dbcounter [-] [118344] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=1 {{(pid=118344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:20:23.972131 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-5f63f353-97d7-412a-9288-e9865afb4c8f tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:20:23.972749 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-5f63f353-97d7-412a-9288-e9865afb4c8f tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] [instance: 25c00062-b8e5-4575-a993-bcace67b3682] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:20:23.979819 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5f63f353-97d7-412a-9288-e9865afb4c8f tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:20:23.980266 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5f63f353-97d7-412a-9288-e9865afb4c8f tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:20:23.981235 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5f63f353-97d7-412a-9288-e9865afb4c8f tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:20:23.981671 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5f63f353-97d7-412a-9288-e9865afb4c8f tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:20:24.074643 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-b0ffaa15-0604-4670-a111-b18d2c7e51a9 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522e94fb0637414a9ceb96f3b8aa3003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc37aee55036430bb0627cdc2cd61011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:20:24.082197 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-b0ffaa15-0604-4670-a111-b18d2c7e51a9 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] 10.222.0.58 "GET /compute/v2.1/servers/b83383fe-a2d7-44e6-ad63-b19b6861adf1" status: 200 len: 1318 microversion: 2.1 time: 0.155742 Jul 21 20:20:24.082964 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 602/1223] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:20:23 2022] GET /compute/v2.1/servers/b83383fe-a2d7-44e6-ad63-b19b6861adf1 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:20:24.124852 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-5f63f353-97d7-412a-9288-e9865afb4c8f tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216eb0b454534a878c30a23e9126ff9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c262cd918784d6490dcd78eda61c551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:20:24.133497 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-5f63f353-97d7-412a-9288-e9865afb4c8f tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] 10.222.0.58 "GET /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682" status: 200 len: 1755 microversion: 2.1 time: 0.165466 Jul 21 20:20:24.134073 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 622/1224] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:20:23 2022] GET /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682 => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:20:25.099356 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-2e79148c-e122-4836-8698-9a423cff07d9 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:20:25.099972 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-2e79148c-e122-4836-8698-9a423cff07d9 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] [instance: b83383fe-a2d7-44e6-ad63-b19b6861adf1] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:20:25.106478 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-2e79148c-e122-4836-8698-9a423cff07d9 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:20:25.106929 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-2e79148c-e122-4836-8698-9a423cff07d9 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:20:25.107737 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-2e79148c-e122-4836-8698-9a423cff07d9 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:20:25.108165 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-2e79148c-e122-4836-8698-9a423cff07d9 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:20:25.157170 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-1415254c-c22a-41c2-a533-0d48aea1feac tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:20:25.157694 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-1415254c-c22a-41c2-a533-0d48aea1feac tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] [instance: 25c00062-b8e5-4575-a993-bcace67b3682] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:20:25.164411 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1415254c-c22a-41c2-a533-0d48aea1feac tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:20:25.164854 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1415254c-c22a-41c2-a533-0d48aea1feac tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:20:25.166329 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1415254c-c22a-41c2-a533-0d48aea1feac tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:20:25.166966 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1415254c-c22a-41c2-a533-0d48aea1feac tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:20:25.249522 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-2e79148c-e122-4836-8698-9a423cff07d9 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522e94fb0637414a9ceb96f3b8aa3003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc37aee55036430bb0627cdc2cd61011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:20:25.257979 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-2e79148c-e122-4836-8698-9a423cff07d9 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] 10.222.0.58 "GET /compute/v2.1/servers/b83383fe-a2d7-44e6-ad63-b19b6861adf1" status: 200 len: 1506 microversion: 2.1 time: 0.162967 Jul 21 20:20:25.258539 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 603/1225] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:20:25 2022] GET /compute/v2.1/servers/b83383fe-a2d7-44e6-ad63-b19b6861adf1 => generated 1506 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:20:25.274348 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-5fa37184-5521-4355-b282-c536ff1c6a2d tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0ac05f31-2e32-4a50-81be-9953c3afd889", "device": "/dev/sdb"}} {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:20:25.276019 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-5fa37184-5521-4355-b282-c536ff1c6a2d tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] [instance: b83383fe-a2d7-44e6-ad63-b19b6861adf1] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:20:25.281984 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-5fa37184-5521-4355-b282-c536ff1c6a2d tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:20:25.282439 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-5fa37184-5521-4355-b282-c536ff1c6a2d tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:20:25.283241 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-5fa37184-5521-4355-b282-c536ff1c6a2d tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:20:25.283681 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-5fa37184-5521-4355-b282-c536ff1c6a2d tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:20:25.325732 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-1415254c-c22a-41c2-a533-0d48aea1feac tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216eb0b454534a878c30a23e9126ff9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c262cd918784d6490dcd78eda61c551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:20:25.334301 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-1415254c-c22a-41c2-a533-0d48aea1feac tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] 10.222.0.58 "GET /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682" status: 200 len: 1758 microversion: 2.1 time: 0.181034 Jul 21 20:20:25.334952 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 623/1226] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:20:25 2022] GET /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682 => generated 1758 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:20:25.953870 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-5fa37184-5521-4355-b282-c536ff1c6a2d tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] 10.222.0.58 "POST /compute/v2.1/servers/b83383fe-a2d7-44e6-ad63-b19b6861adf1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.683254 Jul 21 20:20:25.954688 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 604/1227] 10.222.0.58 () {60 vars in 1322 bytes} [Thu Jul 21 20:20:25 2022] POST /compute/v2.1/servers/b83383fe-a2d7-44e6-ad63-b19b6861adf1/os-volume_attachments => generated 194 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 20:20:49.203258 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-74d716aa-38d3-4311-938e-29bdbf118b78 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:20:49.203781 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-74d716aa-38d3-4311-938e-29bdbf118b78 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] [instance: b83383fe-a2d7-44e6-ad63-b19b6861adf1] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:20:49.205819 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:20:49.206582 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell1:SELECT=14 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:20:49.211756 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-74d716aa-38d3-4311-938e-29bdbf118b78 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:20:49.212202 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-74d716aa-38d3-4311-938e-29bdbf118b78 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:20:49.212965 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-74d716aa-38d3-4311-938e-29bdbf118b78 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:20:49.213399 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-74d716aa-38d3-4311-938e-29bdbf118b78 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:20:49.293162 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.objects.instance [None req-74d716aa-38d3-4311-938e-29bdbf118b78 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lazy-loading 'services' on Instance uuid b83383fe-a2d7-44e6-ad63-b19b6861adf1 {{(pid=118345) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 20:20:49.491585 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-74d716aa-38d3-4311-938e-29bdbf118b78 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b83383fe-a2d7-44e6-ad63-b19b6861adf1/os-volume_attachments/0ac05f31-2e32-4a50-81be-9953c3afd889" status: 202 len: 0 microversion: 2.1 time: 0.292203 Jul 21 20:20:49.492102 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 624/1228] 10.222.0.58 () {58 vars in 1415 bytes} [Thu Jul 21 20:20:49 2022] DELETE /compute/v2.1/servers/b83383fe-a2d7-44e6-ad63-b19b6861adf1/os-volume_attachments/0ac05f31-2e32-4a50-81be-9953c3afd889 => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 20:20:51.651895 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG dbcounter [-] [118344] Writing DB stats nova_api:SELECT=5 {{(pid=118344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:20:51.652685 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG dbcounter [-] [118344] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:20:51.656746 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-40a67019-a9e4-4e04-9db0-6ee038d90ee1 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:20:51.657316 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-40a67019-a9e4-4e04-9db0-6ee038d90ee1 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] [instance: b83383fe-a2d7-44e6-ad63-b19b6861adf1] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:20:51.663879 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-40a67019-a9e4-4e04-9db0-6ee038d90ee1 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:20:51.664314 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-40a67019-a9e4-4e04-9db0-6ee038d90ee1 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:20:51.665061 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-40a67019-a9e4-4e04-9db0-6ee038d90ee1 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:20:51.665503 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-40a67019-a9e4-4e04-9db0-6ee038d90ee1 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:20:51.690263 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-40a67019-a9e4-4e04-9db0-6ee038d90ee1 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] [instance: b83383fe-a2d7-44e6-ad63-b19b6861adf1] Going to try to terminate instance {{(pid=118344) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 20:20:51.886310 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-40a67019-a9e4-4e04-9db0-6ee038d90ee1 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b83383fe-a2d7-44e6-ad63-b19b6861adf1" status: 204 len: 0 microversion: 2.1 time: 0.235735 Jul 21 20:20:51.886902 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 605/1229] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Jul 21 20:20:51 2022] DELETE /compute/v2.1/servers/b83383fe-a2d7-44e6-ad63-b19b6861adf1 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 20:20:51.896079 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-6b5831a7-78e9-4447-b6e7-8aae2979b167 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:20:51.902996 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-6b5831a7-78e9-4447-b6e7-8aae2979b167 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] [instance: b83383fe-a2d7-44e6-ad63-b19b6861adf1] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:20:51.902996 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6b5831a7-78e9-4447-b6e7-8aae2979b167 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:20:51.903467 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6b5831a7-78e9-4447-b6e7-8aae2979b167 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:20:51.904232 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6b5831a7-78e9-4447-b6e7-8aae2979b167 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:20:51.904671 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6b5831a7-78e9-4447-b6e7-8aae2979b167 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:20:52.034398 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-6b5831a7-78e9-4447-b6e7-8aae2979b167 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522e94fb0637414a9ceb96f3b8aa3003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc37aee55036430bb0627cdc2cd61011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:20:52.042348 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-6b5831a7-78e9-4447-b6e7-8aae2979b167 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] 10.222.0.58 "GET /compute/v2.1/servers/b83383fe-a2d7-44e6-ad63-b19b6861adf1" status: 200 len: 1512 microversion: 2.1 time: 0.151048 Jul 21 20:20:52.042917 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 625/1230] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:20:51 2022] GET /compute/v2.1/servers/b83383fe-a2d7-44e6-ad63-b19b6861adf1 => generated 1512 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:20:53.060119 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-b0441e59-0a4f-4db1-8fbe-398f453f8b8a tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:20:53.060848 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-b0441e59-0a4f-4db1-8fbe-398f453f8b8a tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] [instance: b83383fe-a2d7-44e6-ad63-b19b6861adf1] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:20:53.067225 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-b0441e59-0a4f-4db1-8fbe-398f453f8b8a tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:20:53.075040 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-b0441e59-0a4f-4db1-8fbe-398f453f8b8a tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:20:53.075040 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-b0441e59-0a4f-4db1-8fbe-398f453f8b8a tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:20:53.075040 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-b0441e59-0a4f-4db1-8fbe-398f453f8b8a tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:20:53.200391 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-b0441e59-0a4f-4db1-8fbe-398f453f8b8a tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522e94fb0637414a9ceb96f3b8aa3003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc37aee55036430bb0627cdc2cd61011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:20:53.207833 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-b0441e59-0a4f-4db1-8fbe-398f453f8b8a tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] 10.222.0.58 "GET /compute/v2.1/servers/b83383fe-a2d7-44e6-ad63-b19b6861adf1" status: 200 len: 1512 microversion: 2.1 time: 0.152054 Jul 21 20:20:53.208386 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 606/1231] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:20:53 2022] GET /compute/v2.1/servers/b83383fe-a2d7-44e6-ad63-b19b6861adf1 => generated 1512 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:20:54.226822 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-6ce47a63-619f-4762-a308-6b61a3401917 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:20:54.227406 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-6ce47a63-619f-4762-a308-6b61a3401917 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] [instance: b83383fe-a2d7-44e6-ad63-b19b6861adf1] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:20:54.233853 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6ce47a63-619f-4762-a308-6b61a3401917 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:20:54.234299 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6ce47a63-619f-4762-a308-6b61a3401917 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:20:54.235089 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6ce47a63-619f-4762-a308-6b61a3401917 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:20:54.235527 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6ce47a63-619f-4762-a308-6b61a3401917 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:20:54.367236 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-6ce47a63-619f-4762-a308-6b61a3401917 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522e94fb0637414a9ceb96f3b8aa3003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc37aee55036430bb0627cdc2cd61011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:20:54.375126 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-6ce47a63-619f-4762-a308-6b61a3401917 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] 10.222.0.58 "GET /compute/v2.1/servers/b83383fe-a2d7-44e6-ad63-b19b6861adf1" status: 200 len: 1512 microversion: 2.1 time: 0.152860 Jul 21 20:20:54.375712 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 626/1232] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:20:54 2022] GET /compute/v2.1/servers/b83383fe-a2d7-44e6-ad63-b19b6861adf1 => generated 1512 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:20:54.492900 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [req-7f43d5c2-ef01-4b33-8f40-3139963c7912 req-9159be6b-54a8-418e-a17b-82f566351f57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b83383fe-a2d7-44e6-ad63-b19b6861adf1", "name": "network-vif-deleted", "tag": "195f2b31-989a-49e2-bee1-fd2dc7392373"}]} {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:20:54.500710 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [req-7f43d5c2-ef01-4b33-8f40-3139963c7912 req-9159be6b-54a8-418e-a17b-82f566351f57 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:20:54.501259 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [req-7f43d5c2-ef01-4b33-8f40-3139963c7912 req-9159be6b-54a8-418e-a17b-82f566351f57 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:20:54.512137 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.compute.server_external_events [req-7f43d5c2-ef01-4b33-8f40-3139963c7912 req-9159be6b-54a8-418e-a17b-82f566351f57 service nova] Creating event network-vif-deleted:195f2b31-989a-49e2-bee1-fd2dc7392373 for instance b83383fe-a2d7-44e6-ad63-b19b6861adf1 on hv-cinder-85054 Jul 21 20:20:54.517765 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [req-7f43d5c2-ef01-4b33-8f40-3139963c7912 req-9159be6b-54a8-418e-a17b-82f566351f57 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086762 Jul 21 20:20:54.518380 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 607/1233] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 20:20:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:20:55.392417 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-4b68a550-a4b4-461b-aad4-e58b752ea8f9 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:20:55.393139 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-4b68a550-a4b4-461b-aad4-e58b752ea8f9 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] [instance: b83383fe-a2d7-44e6-ad63-b19b6861adf1] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:20:55.399450 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4b68a550-a4b4-461b-aad4-e58b752ea8f9 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:20:55.399892 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4b68a550-a4b4-461b-aad4-e58b752ea8f9 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:20:55.400651 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4b68a550-a4b4-461b-aad4-e58b752ea8f9 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:20:55.401083 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4b68a550-a4b4-461b-aad4-e58b752ea8f9 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:20:55.417221 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.wsgi [None req-4b68a550-a4b4-461b-aad4-e58b752ea8f9 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] HTTP exception thrown: Instance b83383fe-a2d7-44e6-ad63-b19b6861adf1 could not be found. Jul 21 20:20:55.418893 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-4b68a550-a4b4-461b-aad4-e58b752ea8f9 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Request method failure captured: Jul 21 20:20:55.418893 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: request: GET /compute/v2.1/servers/b83383fe-a2d7-44e6-ad63-b19b6861adf1 HTTP/1.1 Jul 21 20:20:55.418893 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Accept: application/json Jul 21 20:20:55.418893 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Accept-Encoding: identity Jul 21 20:20:55.418893 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Connection: close Jul 21 20:20:55.418893 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Content-Length: 0 Jul 21 20:20:55.418893 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Content-Type: application/json Jul 21 20:20:55.418893 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Host: 10.222.0.58 Jul 21 20:20:55.418893 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Openstack-System-Scope: None Jul 21 20:20:55.418893 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: User-Agent: python-urllib3/1.26.9 Jul 21 20:20:55.418893 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Auth-Token: gAAAAABi2bSlc1LtntMsCZpwqE1WWVV804sW-WCyKTxzSfvh_4MXRAa3PJzz4D55YRfBqX6F3-p1i3RgonXzH4OrV35OzFbbZRKm_pUXJIbNcYoBMytmms2EnJQL0A4XaC45HQmI92pVUwRnjrm5GweJkKMzoxX3UlYCDi1TEhgtgI7h_3dbfWg Jul 21 20:20:55.418893 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Domain-Id: None Jul 21 20:20:55.418893 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Domain-Name: None Jul 21 20:20:55.418893 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Identity-Status: Confirmed Jul 21 20:20:55.418893 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Is-Admin-Project: True Jul 21 20:20:55.418893 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Id: default Jul 21 20:20:55.418893 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Name: Default Jul 21 20:20:55.418893 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Id: fc37aee55036430bb0627cdc2cd61011 Jul 21 20:20:55.418893 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Name: tempest-VolumesSnapshotTestJSON-846639818 Jul 21 20:20:55.418893 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Role: reader,member Jul 21 20:20:55.418893 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Roles: reader,member Jul 21 20:20:55.420717 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fc37aee55036430bb0627cdc2cd61011"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fc37aee55036430bb0627cdc2cd61011"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fc37aee55036430bb0627cdc2cd61011"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fc37aee55036430bb0627cdc2cd61011"}]}] Jul 21 20:20:55.420717 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Tenant: tempest-VolumesSnapshotTestJSON-846639818 Jul 21 20:20:55.420717 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Tenant-Id: fc37aee55036430bb0627cdc2cd61011 Jul 21 20:20:55.420717 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-846639818 Jul 21 20:20:55.420717 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User: tempest-VolumesSnapshotTestJSON-846639818-project Jul 21 20:20:55.420717 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Id: default Jul 21 20:20:55.420717 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Name: Default Jul 21 20:20:55.420717 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Id: 522e94fb0637414a9ceb96f3b8aa3003 Jul 21 20:20:55.420717 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Name: tempest-VolumesSnapshotTestJSON-846639818-project Jul 21 20:20:55.420717 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: method: > Jul 21 20:20:55.420717 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: exception: Instance b83383fe-a2d7-44e6-ad63-b19b6861adf1 could not be found. Jul 21 20:20:55.420717 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: action_args: {'id': 'b83383fe-a2d7-44e6-ad63-b19b6861adf1'} Jul 21 20:20:55.421673 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 20:20:55.421673 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:20:55.421673 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 20:20:55.421673 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 20:20:55.421673 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 20:20:55.421673 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 20:20:55.421673 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 20:20:55.421673 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 20:20:55.421673 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 20:20:55.421673 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 20:20:55.421673 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b83383fe-a2d7-44e6-ad63-b19b6861adf1 could not be found. Jul 21 20:20:55.421673 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:20:55.421673 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:20:55.421673 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:20:55.421673 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:20:55.421673 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:20:55.421673 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:20:55.421673 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 20:20:55.421673 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 20:20:55.421673 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 20:20:55.428891 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 20:20:55.428891 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 20:20:55.428891 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 20:20:55.428891 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 20:20:55.428891 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 20:20:55.428891 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 20:20:55.428891 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 20:20:55.428891 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b83383fe-a2d7-44e6-ad63-b19b6861adf1 could not be found. Jul 21 20:20:55.428891 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:20:55.428891 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:20:55.428891 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:20:55.428891 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:20:55.428891 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:20:55.428891 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:20:55.428891 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 20:20:55.428891 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 20:20:55.428891 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b83383fe-a2d7-44e6-ad63-b19b6861adf1 could not be found. Jul 21 20:20:55.428891 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:20:55.430403 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-4b68a550-a4b4-461b-aad4-e58b752ea8f9 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] Returning 404 to user: Instance b83383fe-a2d7-44e6-ad63-b19b6861adf1 could not be found. {{(pid=118345) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 20:20:55.430403 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-4b68a550-a4b4-461b-aad4-e58b752ea8f9 tempest-VolumesSnapshotTestJSON-846639818 tempest-VolumesSnapshotTestJSON-846639818-project] 10.222.0.58 "GET /compute/v2.1/servers/b83383fe-a2d7-44e6-ad63-b19b6861adf1" status: 404 len: 111 microversion: 2.1 time: 0.031843 Jul 21 20:20:55.430403 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 627/1234] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:20:55 2022] GET /compute/v2.1/servers/b83383fe-a2d7-44e6-ad63-b19b6861adf1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 20:21:23.445369 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-8e6e10f2-ce76-4a06-9d27-1dea2300cd5c tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-12598599", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1032901572", "security_groups": [{"name": "tempest-secgroup-smoke-1994785573"}], "block_device_mapping_v2": [{"uuid": "86a803fc-13eb-4f14-abb9-514124ea4f67", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6458e3c6-6a10-4dd1-8440-3ff5b4539889"}]}} {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:21:23.453660 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG dbcounter [-] [118344] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=118344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:21:23.454276 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG dbcounter [-] [118344] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:21:23.558633 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.network.neutron [None req-8e6e10f2-ce76-4a06-9d27-1dea2300cd5c tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] validate_networks() for [('6458e3c6-6a10-4dd1-8440-3ff5b4539889', None, None, None, None, None)] {{(pid=118344) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 20:21:23.937138 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.virt.hardware [None req-8e6e10f2-ce76-4a06-9d27-1dea2300cd5c tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Flavor limits 0:0:0 {{(pid=118344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 20:21:23.937592 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.virt.hardware [None req-8e6e10f2-ce76-4a06-9d27-1dea2300cd5c tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Image limits 0:0:0 {{(pid=118344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 20:21:23.938077 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.virt.hardware [None req-8e6e10f2-ce76-4a06-9d27-1dea2300cd5c tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Flavor pref 0:0:0 {{(pid=118344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 20:21:23.938510 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.virt.hardware [None req-8e6e10f2-ce76-4a06-9d27-1dea2300cd5c tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Image pref 0:0:0 {{(pid=118344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 20:21:23.938923 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.virt.hardware [None req-8e6e10f2-ce76-4a06-9d27-1dea2300cd5c tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 20:21:23.947896 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-8e6e10f2-ce76-4a06-9d27-1dea2300cd5c tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:21:23.948348 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-8e6e10f2-ce76-4a06-9d27-1dea2300cd5c tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:21:23.949149 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-8e6e10f2-ce76-4a06-9d27-1dea2300cd5c tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:21:23.949587 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-8e6e10f2-ce76-4a06-9d27-1dea2300cd5c tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:21:23.966497 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.quota [None req-8e6e10f2-ce76-4a06-9d27-1dea2300cd5c tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Getting quotas for project 997a259cf4b240fba9b065a43b2ed4fc. Resources: {'instances', 'cores', 'ram'} {{(pid=118344) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 20:21:23.970434 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.quota [None req-8e6e10f2-ce76-4a06-9d27-1dea2300cd5c tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Getting quotas for user c4460571d9294e38931274a55c6c5857 and project 997a259cf4b240fba9b065a43b2ed4fc. Resources: {'instances', 'cores', 'ram'} {{(pid=118344) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 20:21:24.026898 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-8e6e10f2-ce76-4a06-9d27-1dea2300cd5c tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Going to run 1 instances... {{(pid=118344) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 20:21:24.029152 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-8e6e10f2-ce76-4a06-9d27-1dea2300cd5c tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] [instance: 4aad6915-17c7-42b8-8439-56a088c8d8c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='86a803fc-13eb-4f14-abb9-514124ea4f67',volume_size=None,volume_type=None)] {{(pid=118344) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 20:21:24.433840 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR oslo.messaging._drivers.impl_rabbit [None req-8e6e10f2-ce76-4a06-9d27-1dea2300cd5c tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] [9ea59f23-42f4-4e9e-812f-a1ef024d16cb] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 21 20:21:25.441293 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO oslo.messaging._drivers.impl_rabbit [None req-8e6e10f2-ce76-4a06-9d27-1dea2300cd5c tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] [9ea59f23-42f4-4e9e-812f-a1ef024d16cb] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 44650. Jul 21 20:21:25.445815 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-8e6e10f2-ce76-4a06-9d27-1dea2300cd5c tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.004686 Jul 21 20:21:25.446606 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 608/1235] 10.222.0.58 () {60 vars in 1146 bytes} [Thu Jul 21 20:21:23 2022] POST /compute/v2.1/servers => generated 406 bytes in 2006 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 20:21:25.456678 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-7b3b1fd8-c7eb-4160-9191-a1f83428a6c5 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:21:25.457301 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-7b3b1fd8-c7eb-4160-9191-a1f83428a6c5 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] [instance: 4aad6915-17c7-42b8-8439-56a088c8d8c3] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:21:25.460986 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_api:SELECT=8 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:21:25.461476 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:21:25.515991 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-7b3b1fd8-c7eb-4160-9191-a1f83428a6c5 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4460571d9294e38931274a55c6c5857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a259cf4b240fba9b065a43b2ed4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:21:25.522984 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-7b3b1fd8-c7eb-4160-9191-a1f83428a6c5 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] 10.222.0.58 "GET /compute/v2.1/servers/4aad6915-17c7-42b8-8439-56a088c8d8c3" status: 200 len: 1093 microversion: 2.1 time: 0.070008 Jul 21 20:21:25.523650 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 628/1236] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:21:25 2022] GET /compute/v2.1/servers/4aad6915-17c7-42b8-8439-56a088c8d8c3 => generated 1093 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:21:26.541649 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-697b1f0f-8118-47f8-80df-ed9e6d4357a6 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:21:26.542215 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-697b1f0f-8118-47f8-80df-ed9e6d4357a6 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] [instance: 4aad6915-17c7-42b8-8439-56a088c8d8c3] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:21:26.597031 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-697b1f0f-8118-47f8-80df-ed9e6d4357a6 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4460571d9294e38931274a55c6c5857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a259cf4b240fba9b065a43b2ed4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:21:26.603938 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-697b1f0f-8118-47f8-80df-ed9e6d4357a6 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] 10.222.0.58 "GET /compute/v2.1/servers/4aad6915-17c7-42b8-8439-56a088c8d8c3" status: 200 len: 1093 microversion: 2.1 time: 0.066829 Jul 21 20:21:26.604588 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 609/1237] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:21:26 2022] GET /compute/v2.1/servers/4aad6915-17c7-42b8-8439-56a088c8d8c3 => generated 1093 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:21:27.621359 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-2de49245-a131-4401-a847-8542329a2879 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:21:27.622035 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-2de49245-a131-4401-a847-8542329a2879 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] [instance: 4aad6915-17c7-42b8-8439-56a088c8d8c3] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:21:27.678628 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-2de49245-a131-4401-a847-8542329a2879 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4460571d9294e38931274a55c6c5857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a259cf4b240fba9b065a43b2ed4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:21:27.685921 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-2de49245-a131-4401-a847-8542329a2879 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] 10.222.0.58 "GET /compute/v2.1/servers/4aad6915-17c7-42b8-8439-56a088c8d8c3" status: 200 len: 1093 microversion: 2.1 time: 0.069057 Jul 21 20:21:27.686492 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 629/1238] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:21:27 2022] GET /compute/v2.1/servers/4aad6915-17c7-42b8-8439-56a088c8d8c3 => generated 1093 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:21:28.702957 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-db493644-5c00-459e-bd74-6a52daa85c93 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:21:28.704122 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-db493644-5c00-459e-bd74-6a52daa85c93 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] [instance: 4aad6915-17c7-42b8-8439-56a088c8d8c3] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:21:28.764672 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-db493644-5c00-459e-bd74-6a52daa85c93 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4460571d9294e38931274a55c6c5857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a259cf4b240fba9b065a43b2ed4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:21:28.771485 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-db493644-5c00-459e-bd74-6a52daa85c93 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] 10.222.0.58 "GET /compute/v2.1/servers/4aad6915-17c7-42b8-8439-56a088c8d8c3" status: 200 len: 1093 microversion: 2.1 time: 0.072471 Jul 21 20:21:28.772048 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 610/1239] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:21:28 2022] GET /compute/v2.1/servers/4aad6915-17c7-42b8-8439-56a088c8d8c3 => generated 1093 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:21:29.789194 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-697a424c-4c11-4896-8a81-bb28001b1bd5 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:21:29.789801 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-697a424c-4c11-4896-8a81-bb28001b1bd5 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] [instance: 4aad6915-17c7-42b8-8439-56a088c8d8c3] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:21:29.796707 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-697a424c-4c11-4896-8a81-bb28001b1bd5 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:21:29.797234 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-697a424c-4c11-4896-8a81-bb28001b1bd5 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:21:29.798167 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-697a424c-4c11-4896-8a81-bb28001b1bd5 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:21:29.798741 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-697a424c-4c11-4896-8a81-bb28001b1bd5 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:21:29.862522 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-697a424c-4c11-4896-8a81-bb28001b1bd5 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4460571d9294e38931274a55c6c5857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a259cf4b240fba9b065a43b2ed4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:21:29.872916 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-697a424c-4c11-4896-8a81-bb28001b1bd5 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] 10.222.0.58 "GET /compute/v2.1/servers/4aad6915-17c7-42b8-8439-56a088c8d8c3" status: 200 len: 1143 microversion: 2.1 time: 0.087643 Jul 21 20:21:29.873326 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 630/1240] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:21:29 2022] GET /compute/v2.1/servers/4aad6915-17c7-42b8-8439-56a088c8d8c3 => generated 1143 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:21:30.890287 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-faf485db-01a3-4774-b317-722e2941679b tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:21:30.890960 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-faf485db-01a3-4774-b317-722e2941679b tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] [instance: 4aad6915-17c7-42b8-8439-56a088c8d8c3] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:21:30.898428 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-faf485db-01a3-4774-b317-722e2941679b tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:21:30.898889 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-faf485db-01a3-4774-b317-722e2941679b tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:21:30.899685 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-faf485db-01a3-4774-b317-722e2941679b tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:21:30.900117 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-faf485db-01a3-4774-b317-722e2941679b tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:21:30.960376 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-faf485db-01a3-4774-b317-722e2941679b tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4460571d9294e38931274a55c6c5857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a259cf4b240fba9b065a43b2ed4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:21:30.967803 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-faf485db-01a3-4774-b317-722e2941679b tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] 10.222.0.58 "GET /compute/v2.1/servers/4aad6915-17c7-42b8-8439-56a088c8d8c3" status: 200 len: 1135 microversion: 2.1 time: 0.082090 Jul 21 20:21:30.968372 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 611/1241] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:21:30 2022] GET /compute/v2.1/servers/4aad6915-17c7-42b8-8439-56a088c8d8c3 => generated 1135 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:21:31.984886 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-95e2ac8e-51c0-4819-be62-4bd645bec7db tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:21:31.985486 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-95e2ac8e-51c0-4819-be62-4bd645bec7db tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] [instance: 4aad6915-17c7-42b8-8439-56a088c8d8c3] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:21:31.991965 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-95e2ac8e-51c0-4819-be62-4bd645bec7db tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:21:31.992410 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-95e2ac8e-51c0-4819-be62-4bd645bec7db tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:21:31.993169 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-95e2ac8e-51c0-4819-be62-4bd645bec7db tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:21:31.993603 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-95e2ac8e-51c0-4819-be62-4bd645bec7db tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:21:32.055831 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-95e2ac8e-51c0-4819-be62-4bd645bec7db tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4460571d9294e38931274a55c6c5857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a259cf4b240fba9b065a43b2ed4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:21:32.063538 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-95e2ac8e-51c0-4819-be62-4bd645bec7db tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] 10.222.0.58 "GET /compute/v2.1/servers/4aad6915-17c7-42b8-8439-56a088c8d8c3" status: 200 len: 1209 microversion: 2.1 time: 0.082630 Jul 21 20:21:32.064129 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 631/1242] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:21:31 2022] GET /compute/v2.1/servers/4aad6915-17c7-42b8-8439-56a088c8d8c3 => generated 1209 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:21:33.080825 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-a95ef894-777f-499e-9a82-c196d1b79206 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:21:33.081519 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-a95ef894-777f-499e-9a82-c196d1b79206 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] [instance: 4aad6915-17c7-42b8-8439-56a088c8d8c3] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:21:33.087783 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-a95ef894-777f-499e-9a82-c196d1b79206 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:21:33.088309 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-a95ef894-777f-499e-9a82-c196d1b79206 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:21:33.089892 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-a95ef894-777f-499e-9a82-c196d1b79206 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:21:33.090414 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-a95ef894-777f-499e-9a82-c196d1b79206 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:21:33.265564 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-a95ef894-777f-499e-9a82-c196d1b79206 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4460571d9294e38931274a55c6c5857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a259cf4b240fba9b065a43b2ed4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:21:33.273008 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-a95ef894-777f-499e-9a82-c196d1b79206 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] 10.222.0.58 "GET /compute/v2.1/servers/4aad6915-17c7-42b8-8439-56a088c8d8c3" status: 200 len: 1265 microversion: 2.1 time: 0.196365 Jul 21 20:21:33.273571 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 612/1243] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:21:33 2022] GET /compute/v2.1/servers/4aad6915-17c7-42b8-8439-56a088c8d8c3 => generated 1265 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:21:33.749906 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [req-cd33bade-8041-42dd-bdf1-5cce14499e23 req-cacac55e-4b6e-4046-8fd0-7b526a62b566 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4aad6915-17c7-42b8-8439-56a088c8d8c3", "tag": "482aade5-ab2e-4d3f-9ec5-abb78514eeaf"}]} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:21:33.760207 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-cd33bade-8041-42dd-bdf1-5cce14499e23 req-cacac55e-4b6e-4046-8fd0-7b526a62b566 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:21:33.761412 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-cd33bade-8041-42dd-bdf1-5cce14499e23 req-cacac55e-4b6e-4046-8fd0-7b526a62b566 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:21:33.779134 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.compute.server_external_events [req-cd33bade-8041-42dd-bdf1-5cce14499e23 req-cacac55e-4b6e-4046-8fd0-7b526a62b566 service nova] Creating event network-changed:482aade5-ab2e-4d3f-9ec5-abb78514eeaf for instance 4aad6915-17c7-42b8-8439-56a088c8d8c3 on hv-cinder-85054 Jul 21 20:21:33.786132 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [req-cd33bade-8041-42dd-bdf1-5cce14499e23 req-cacac55e-4b6e-4046-8fd0-7b526a62b566 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041173 Jul 21 20:21:33.788338 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 632/1244] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 20:21:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:21:34.291183 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-1ed4b466-4a57-4d0e-bee1-2d03f965407b tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:21:34.292369 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-1ed4b466-4a57-4d0e-bee1-2d03f965407b tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] [instance: 4aad6915-17c7-42b8-8439-56a088c8d8c3] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:21:34.294258 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG dbcounter [-] [118344] Writing DB stats nova_cell0:SELECT=2 {{(pid=118344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:21:34.299877 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-1ed4b466-4a57-4d0e-bee1-2d03f965407b tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:21:34.300326 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-1ed4b466-4a57-4d0e-bee1-2d03f965407b tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:21:34.301097 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-1ed4b466-4a57-4d0e-bee1-2d03f965407b tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:21:34.301535 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-1ed4b466-4a57-4d0e-bee1-2d03f965407b tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:21:34.518356 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-1ed4b466-4a57-4d0e-bee1-2d03f965407b tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4460571d9294e38931274a55c6c5857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a259cf4b240fba9b065a43b2ed4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:21:34.527826 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-1ed4b466-4a57-4d0e-bee1-2d03f965407b tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] 10.222.0.58 "GET /compute/v2.1/servers/4aad6915-17c7-42b8-8439-56a088c8d8c3" status: 200 len: 1265 microversion: 2.1 time: 0.240803 Jul 21 20:21:34.529397 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 613/1245] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:21:34 2022] GET /compute/v2.1/servers/4aad6915-17c7-42b8-8439-56a088c8d8c3 => generated 1265 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:21:35.466200 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 20:21:35.466802 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Thu Jul 21 20:21:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 20:21:35.544972 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-821ec44e-1714-4a0c-bd1c-a17c18a715b9 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:21:35.545665 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-821ec44e-1714-4a0c-bd1c-a17c18a715b9 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] [instance: 4aad6915-17c7-42b8-8439-56a088c8d8c3] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:21:35.552458 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-821ec44e-1714-4a0c-bd1c-a17c18a715b9 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:21:35.552892 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-821ec44e-1714-4a0c-bd1c-a17c18a715b9 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:21:35.553640 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-821ec44e-1714-4a0c-bd1c-a17c18a715b9 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:21:35.554063 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-821ec44e-1714-4a0c-bd1c-a17c18a715b9 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:21:35.684850 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-821ec44e-1714-4a0c-bd1c-a17c18a715b9 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4460571d9294e38931274a55c6c5857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a259cf4b240fba9b065a43b2ed4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:21:35.692246 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-821ec44e-1714-4a0c-bd1c-a17c18a715b9 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] 10.222.0.58 "GET /compute/v2.1/servers/4aad6915-17c7-42b8-8439-56a088c8d8c3" status: 200 len: 1265 microversion: 2.1 time: 0.151446 Jul 21 20:21:35.692795 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 633/1246] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:21:35 2022] GET /compute/v2.1/servers/4aad6915-17c7-42b8-8439-56a088c8d8c3 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:21:36.708995 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-a83f8abc-a0e0-4f40-8de4-187fef3cd03e tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:21:36.709609 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-a83f8abc-a0e0-4f40-8de4-187fef3cd03e tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] [instance: 4aad6915-17c7-42b8-8439-56a088c8d8c3] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:21:36.717290 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-a83f8abc-a0e0-4f40-8de4-187fef3cd03e tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:21:36.722592 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-a83f8abc-a0e0-4f40-8de4-187fef3cd03e tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:21:36.722592 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-a83f8abc-a0e0-4f40-8de4-187fef3cd03e tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:21:36.722592 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-a83f8abc-a0e0-4f40-8de4-187fef3cd03e tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:21:36.850761 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-a83f8abc-a0e0-4f40-8de4-187fef3cd03e tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4460571d9294e38931274a55c6c5857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a259cf4b240fba9b065a43b2ed4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:21:36.858209 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-a83f8abc-a0e0-4f40-8de4-187fef3cd03e tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] 10.222.0.58 "GET /compute/v2.1/servers/4aad6915-17c7-42b8-8439-56a088c8d8c3" status: 200 len: 1265 microversion: 2.1 time: 0.153276 Jul 21 20:21:36.858778 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 614/1247] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:21:36 2022] GET /compute/v2.1/servers/4aad6915-17c7-42b8-8439-56a088c8d8c3 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:21:37.874220 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-8f0517b1-36e9-422a-8efa-b4b6ddd14883 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:21:37.874832 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-8f0517b1-36e9-422a-8efa-b4b6ddd14883 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] [instance: 4aad6915-17c7-42b8-8439-56a088c8d8c3] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:21:37.877117 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell0:SELECT=4 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:21:37.881978 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8f0517b1-36e9-422a-8efa-b4b6ddd14883 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:21:37.882419 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8f0517b1-36e9-422a-8efa-b4b6ddd14883 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:21:37.883213 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8f0517b1-36e9-422a-8efa-b4b6ddd14883 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:21:37.883645 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8f0517b1-36e9-422a-8efa-b4b6ddd14883 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:21:38.012796 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-8f0517b1-36e9-422a-8efa-b4b6ddd14883 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4460571d9294e38931274a55c6c5857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a259cf4b240fba9b065a43b2ed4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:21:38.020458 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-8f0517b1-36e9-422a-8efa-b4b6ddd14883 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] 10.222.0.58 "GET /compute/v2.1/servers/4aad6915-17c7-42b8-8439-56a088c8d8c3" status: 200 len: 1265 microversion: 2.1 time: 0.150052 Jul 21 20:21:38.021058 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 634/1248] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:21:37 2022] GET /compute/v2.1/servers/4aad6915-17c7-42b8-8439-56a088c8d8c3 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:21:39.038200 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-9ff8fa9e-e02d-46ef-9918-c18aaac0cfe0 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:21:39.038806 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-9ff8fa9e-e02d-46ef-9918-c18aaac0cfe0 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] [instance: 4aad6915-17c7-42b8-8439-56a088c8d8c3] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:21:39.041123 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG dbcounter [-] [118344] Writing DB stats nova_cell0:SELECT=10 {{(pid=118344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:21:39.046526 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-9ff8fa9e-e02d-46ef-9918-c18aaac0cfe0 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:21:39.046969 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-9ff8fa9e-e02d-46ef-9918-c18aaac0cfe0 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:21:39.047759 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-9ff8fa9e-e02d-46ef-9918-c18aaac0cfe0 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:21:39.048189 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-9ff8fa9e-e02d-46ef-9918-c18aaac0cfe0 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:21:39.181851 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-9ff8fa9e-e02d-46ef-9918-c18aaac0cfe0 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4460571d9294e38931274a55c6c5857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a259cf4b240fba9b065a43b2ed4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:21:39.190041 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-9ff8fa9e-e02d-46ef-9918-c18aaac0cfe0 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] 10.222.0.58 "GET /compute/v2.1/servers/4aad6915-17c7-42b8-8439-56a088c8d8c3" status: 200 len: 1265 microversion: 2.1 time: 0.155713 Jul 21 20:21:39.191854 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 615/1249] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:21:39 2022] GET /compute/v2.1/servers/4aad6915-17c7-42b8-8439-56a088c8d8c3 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:21:40.207728 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-b5021407-776a-4b09-b37c-cee1d9ae35d2 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:21:40.208372 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-b5021407-776a-4b09-b37c-cee1d9ae35d2 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] [instance: 4aad6915-17c7-42b8-8439-56a088c8d8c3] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:21:40.214825 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b5021407-776a-4b09-b37c-cee1d9ae35d2 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:21:40.215301 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b5021407-776a-4b09-b37c-cee1d9ae35d2 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:21:40.216660 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b5021407-776a-4b09-b37c-cee1d9ae35d2 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:21:40.217093 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b5021407-776a-4b09-b37c-cee1d9ae35d2 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:21:40.349916 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-b5021407-776a-4b09-b37c-cee1d9ae35d2 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4460571d9294e38931274a55c6c5857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a259cf4b240fba9b065a43b2ed4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:21:40.357285 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-b5021407-776a-4b09-b37c-cee1d9ae35d2 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] 10.222.0.58 "GET /compute/v2.1/servers/4aad6915-17c7-42b8-8439-56a088c8d8c3" status: 200 len: 1265 microversion: 2.1 time: 0.153479 Jul 21 20:21:40.359823 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 635/1250] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:21:40 2022] GET /compute/v2.1/servers/4aad6915-17c7-42b8-8439-56a088c8d8c3 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:21:41.374430 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-46b51a29-d4d7-450b-92eb-c9e23b7d3e35 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:21:41.376720 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-46b51a29-d4d7-450b-92eb-c9e23b7d3e35 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] [instance: 4aad6915-17c7-42b8-8439-56a088c8d8c3] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:21:41.381557 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-46b51a29-d4d7-450b-92eb-c9e23b7d3e35 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:21:41.381997 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-46b51a29-d4d7-450b-92eb-c9e23b7d3e35 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:21:41.382752 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-46b51a29-d4d7-450b-92eb-c9e23b7d3e35 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:21:41.383216 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-46b51a29-d4d7-450b-92eb-c9e23b7d3e35 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:21:41.511946 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-46b51a29-d4d7-450b-92eb-c9e23b7d3e35 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4460571d9294e38931274a55c6c5857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a259cf4b240fba9b065a43b2ed4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:21:41.519928 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-46b51a29-d4d7-450b-92eb-c9e23b7d3e35 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] 10.222.0.58 "GET /compute/v2.1/servers/4aad6915-17c7-42b8-8439-56a088c8d8c3" status: 200 len: 1265 microversion: 2.1 time: 0.150025 Jul 21 20:21:41.520491 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 616/1251] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:21:41 2022] GET /compute/v2.1/servers/4aad6915-17c7-42b8-8439-56a088c8d8c3 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:21:42.537027 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-1dd75c0b-11e6-49b3-a1ee-39b9a373351b tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:21:42.537640 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-1dd75c0b-11e6-49b3-a1ee-39b9a373351b tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] [instance: 4aad6915-17c7-42b8-8439-56a088c8d8c3] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:21:42.543742 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1dd75c0b-11e6-49b3-a1ee-39b9a373351b tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:21:42.544186 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1dd75c0b-11e6-49b3-a1ee-39b9a373351b tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:21:42.544948 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1dd75c0b-11e6-49b3-a1ee-39b9a373351b tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:21:42.545380 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1dd75c0b-11e6-49b3-a1ee-39b9a373351b tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:21:42.679120 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-1dd75c0b-11e6-49b3-a1ee-39b9a373351b tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4460571d9294e38931274a55c6c5857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a259cf4b240fba9b065a43b2ed4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:21:42.686607 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-1dd75c0b-11e6-49b3-a1ee-39b9a373351b tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] 10.222.0.58 "GET /compute/v2.1/servers/4aad6915-17c7-42b8-8439-56a088c8d8c3" status: 200 len: 1265 microversion: 2.1 time: 0.153446 Jul 21 20:21:42.687193 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 636/1252] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:21:42 2022] GET /compute/v2.1/servers/4aad6915-17c7-42b8-8439-56a088c8d8c3 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:21:43.703500 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-da434f0f-18c7-414a-b635-c5fa33e4e2d9 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:21:43.704111 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-da434f0f-18c7-414a-b635-c5fa33e4e2d9 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] [instance: 4aad6915-17c7-42b8-8439-56a088c8d8c3] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:21:43.710597 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-da434f0f-18c7-414a-b635-c5fa33e4e2d9 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:21:43.711068 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-da434f0f-18c7-414a-b635-c5fa33e4e2d9 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:21:43.711838 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-da434f0f-18c7-414a-b635-c5fa33e4e2d9 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:21:43.712277 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-da434f0f-18c7-414a-b635-c5fa33e4e2d9 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:21:43.845039 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-da434f0f-18c7-414a-b635-c5fa33e4e2d9 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4460571d9294e38931274a55c6c5857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a259cf4b240fba9b065a43b2ed4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:21:43.852780 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-da434f0f-18c7-414a-b635-c5fa33e4e2d9 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] 10.222.0.58 "GET /compute/v2.1/servers/4aad6915-17c7-42b8-8439-56a088c8d8c3" status: 200 len: 1265 microversion: 2.1 time: 0.153330 Jul 21 20:21:43.853337 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 617/1253] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:21:43 2022] GET /compute/v2.1/servers/4aad6915-17c7-42b8-8439-56a088c8d8c3 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:21:44.508656 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [req-8eaf8fa2-5ae4-445c-a319-ad349edd4056 req-8acd22ec-a7b5-47eb-8f4b-e430e32eb9ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4aad6915-17c7-42b8-8439-56a088c8d8c3", "name": "network-vif-plugged", "status": "completed", "tag": "482aade5-ab2e-4d3f-9ec5-abb78514eeaf"}]} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:21:44.517697 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-8eaf8fa2-5ae4-445c-a319-ad349edd4056 req-8acd22ec-a7b5-47eb-8f4b-e430e32eb9ec service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:21:44.518137 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-8eaf8fa2-5ae4-445c-a319-ad349edd4056 req-8acd22ec-a7b5-47eb-8f4b-e430e32eb9ec service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:21:44.529400 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.compute.server_external_events [req-8eaf8fa2-5ae4-445c-a319-ad349edd4056 req-8acd22ec-a7b5-47eb-8f4b-e430e32eb9ec service nova] Creating event network-vif-plugged:482aade5-ab2e-4d3f-9ec5-abb78514eeaf for instance 4aad6915-17c7-42b8-8439-56a088c8d8c3 on hv-cinder-85054 Jul 21 20:21:44.534712 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [req-8eaf8fa2-5ae4-445c-a319-ad349edd4056 req-8acd22ec-a7b5-47eb-8f4b-e430e32eb9ec service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.212193 Jul 21 20:21:44.535361 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 637/1254] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 20:21:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:21:44.872396 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-cbe736d2-f2ee-4d2b-9e1e-b4540e768201 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:21:44.873649 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-cbe736d2-f2ee-4d2b-9e1e-b4540e768201 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] [instance: 4aad6915-17c7-42b8-8439-56a088c8d8c3] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:21:44.880275 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-cbe736d2-f2ee-4d2b-9e1e-b4540e768201 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:21:44.880722 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-cbe736d2-f2ee-4d2b-9e1e-b4540e768201 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:21:44.881530 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-cbe736d2-f2ee-4d2b-9e1e-b4540e768201 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:21:44.881967 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-cbe736d2-f2ee-4d2b-9e1e-b4540e768201 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:21:45.038752 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-cbe736d2-f2ee-4d2b-9e1e-b4540e768201 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4460571d9294e38931274a55c6c5857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a259cf4b240fba9b065a43b2ed4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:21:45.046932 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-cbe736d2-f2ee-4d2b-9e1e-b4540e768201 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] 10.222.0.58 "GET /compute/v2.1/servers/4aad6915-17c7-42b8-8439-56a088c8d8c3" status: 200 len: 1265 microversion: 2.1 time: 0.178532 Jul 21 20:21:45.047527 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 618/1255] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:21:44 2022] GET /compute/v2.1/servers/4aad6915-17c7-42b8-8439-56a088c8d8c3 => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:21:46.065431 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-38d20fea-4ddb-46c0-b22d-de3b3dbd0c7b tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:21:46.066035 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-38d20fea-4ddb-46c0-b22d-de3b3dbd0c7b tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] [instance: 4aad6915-17c7-42b8-8439-56a088c8d8c3] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:21:46.072188 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-38d20fea-4ddb-46c0-b22d-de3b3dbd0c7b tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:21:46.072659 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-38d20fea-4ddb-46c0-b22d-de3b3dbd0c7b tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:21:46.073407 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-38d20fea-4ddb-46c0-b22d-de3b3dbd0c7b tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:21:46.073838 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-38d20fea-4ddb-46c0-b22d-de3b3dbd0c7b tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:21:46.210854 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-38d20fea-4ddb-46c0-b22d-de3b3dbd0c7b tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4460571d9294e38931274a55c6c5857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a259cf4b240fba9b065a43b2ed4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:21:46.218321 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-38d20fea-4ddb-46c0-b22d-de3b3dbd0c7b tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] 10.222.0.58 "GET /compute/v2.1/servers/4aad6915-17c7-42b8-8439-56a088c8d8c3" status: 200 len: 1265 microversion: 2.1 time: 0.158275 Jul 21 20:21:46.218882 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 638/1256] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:21:46 2022] GET /compute/v2.1/servers/4aad6915-17c7-42b8-8439-56a088c8d8c3 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:21:47.235384 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-7522e183-434d-495b-855c-447d6af10ff4 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:21:47.235963 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-7522e183-434d-495b-855c-447d6af10ff4 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] [instance: 4aad6915-17c7-42b8-8439-56a088c8d8c3] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:21:47.242479 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-7522e183-434d-495b-855c-447d6af10ff4 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:21:47.242916 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-7522e183-434d-495b-855c-447d6af10ff4 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:21:47.243745 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-7522e183-434d-495b-855c-447d6af10ff4 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:21:47.244180 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-7522e183-434d-495b-855c-447d6af10ff4 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:21:47.378143 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-7522e183-434d-495b-855c-447d6af10ff4 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4460571d9294e38931274a55c6c5857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a259cf4b240fba9b065a43b2ed4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:21:47.385849 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-7522e183-434d-495b-855c-447d6af10ff4 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] 10.222.0.58 "GET /compute/v2.1/servers/4aad6915-17c7-42b8-8439-56a088c8d8c3" status: 200 len: 1452 microversion: 2.1 time: 0.154472 Jul 21 20:21:47.386410 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 619/1257] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:21:47 2022] GET /compute/v2.1/servers/4aad6915-17c7-42b8-8439-56a088c8d8c3 => generated 1452 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:21:47.402512 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-3a48e40b-a34c-4fa9-b880-28e92f36df1a tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:21:47.403145 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-3a48e40b-a34c-4fa9-b880-28e92f36df1a tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] [instance: 4aad6915-17c7-42b8-8439-56a088c8d8c3] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:21:47.410296 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3a48e40b-a34c-4fa9-b880-28e92f36df1a tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:21:47.410734 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3a48e40b-a34c-4fa9-b880-28e92f36df1a tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:21:47.411516 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3a48e40b-a34c-4fa9-b880-28e92f36df1a tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:21:47.411945 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3a48e40b-a34c-4fa9-b880-28e92f36df1a tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:21:47.539855 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-3a48e40b-a34c-4fa9-b880-28e92f36df1a tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4460571d9294e38931274a55c6c5857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a259cf4b240fba9b065a43b2ed4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:21:47.547888 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-3a48e40b-a34c-4fa9-b880-28e92f36df1a tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] 10.222.0.58 "GET /compute/v2.1/servers/4aad6915-17c7-42b8-8439-56a088c8d8c3" status: 200 len: 1452 microversion: 2.1 time: 0.149172 Jul 21 20:21:47.548445 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 639/1258] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:21:47 2022] GET /compute/v2.1/servers/4aad6915-17c7-42b8-8439-56a088c8d8c3 => generated 1452 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:21:49.478748 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-fd88f798-e21b-4906-a270-409711e60d86 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-973213736"}} {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:21:49.479525 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-fd88f798-e21b-4906-a270-409711e60d86 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] [instance: 25c00062-b8e5-4575-a993-bcace67b3682] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:21:49.487224 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-fd88f798-e21b-4906-a270-409711e60d86 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:21:49.487754 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-fd88f798-e21b-4906-a270-409711e60d86 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:21:49.488785 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-fd88f798-e21b-4906-a270-409711e60d86 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:21:49.489315 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-fd88f798-e21b-4906-a270-409711e60d86 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:21:49.655207 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.network.security_group_api [None req-fd88f798-e21b-4906-a270-409711e60d86 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Removing security group ece0226d-86ac-4d8a-ab26-4b8ecf68b1f2 from port eae9dff4-a338-4cab-b3de-c05350da7fab Jul 21 20:21:49.670876 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [req-f86519c6-2f99-4b55-9e34-e1b4f14f993c req-7434565e-c0e5-4b1b-82dd-4a9ff72e2863 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4aad6915-17c7-42b8-8439-56a088c8d8c3", "tag": "482aade5-ab2e-4d3f-9ec5-abb78514eeaf"}]} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:21:49.682737 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-f86519c6-2f99-4b55-9e34-e1b4f14f993c req-7434565e-c0e5-4b1b-82dd-4a9ff72e2863 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:21:49.683459 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-f86519c6-2f99-4b55-9e34-e1b4f14f993c req-7434565e-c0e5-4b1b-82dd-4a9ff72e2863 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:21:49.695137 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.compute.server_external_events [req-f86519c6-2f99-4b55-9e34-e1b4f14f993c req-7434565e-c0e5-4b1b-82dd-4a9ff72e2863 service nova] Creating event network-changed:482aade5-ab2e-4d3f-9ec5-abb78514eeaf for instance 4aad6915-17c7-42b8-8439-56a088c8d8c3 on hv-cinder-85054 Jul 21 20:21:49.700540 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [req-f86519c6-2f99-4b55-9e34-e1b4f14f993c req-7434565e-c0e5-4b1b-82dd-4a9ff72e2863 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033670 Jul 21 20:21:49.701387 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 640/1259] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 20:21:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 20:21:50.526558 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-fd88f798-e21b-4906-a270-409711e60d86 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] 10.222.0.58 "POST /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682/action" status: 202 len: 0 microversion: 2.1 time: 1.052514 Jul 21 20:21:50.530845 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 620/1260] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Jul 21 20:21:49 2022] POST /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682/action => generated 0 bytes in 1057 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 20:21:51.717676 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [req-e38f9b44-158b-4b79-b3ab-4ccb4e557ac5 req-2bbc8fa0-593f-436a-817a-01709d501e7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25c00062-b8e5-4575-a993-bcace67b3682", "tag": "eae9dff4-a338-4cab-b3de-c05350da7fab"}]} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:21:51.726537 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-e38f9b44-158b-4b79-b3ab-4ccb4e557ac5 req-2bbc8fa0-593f-436a-817a-01709d501e7e service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:21:51.726977 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-e38f9b44-158b-4b79-b3ab-4ccb4e557ac5 req-2bbc8fa0-593f-436a-817a-01709d501e7e service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:21:51.738645 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.compute.server_external_events [req-e38f9b44-158b-4b79-b3ab-4ccb4e557ac5 req-2bbc8fa0-593f-436a-817a-01709d501e7e service nova] Creating event network-changed:eae9dff4-a338-4cab-b3de-c05350da7fab for instance 25c00062-b8e5-4575-a993-bcace67b3682 on hv-cinder-85054 Jul 21 20:21:51.744784 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [req-e38f9b44-158b-4b79-b3ab-4ccb4e557ac5 req-2bbc8fa0-593f-436a-817a-01709d501e7e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031570 Jul 21 20:21:51.745751 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 641/1261] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 20:21:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:21:51.780272 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-85907a3a-bbf6-490b-99d7-9c8466c0c9ac tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:21:51.780807 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-85907a3a-bbf6-490b-99d7-9c8466c0c9ac tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] [instance: 25c00062-b8e5-4575-a993-bcace67b3682] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:21:51.787057 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-85907a3a-bbf6-490b-99d7-9c8466c0c9ac tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:21:51.787502 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-85907a3a-bbf6-490b-99d7-9c8466c0c9ac tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:21:51.788273 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-85907a3a-bbf6-490b-99d7-9c8466c0c9ac tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:21:51.788714 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-85907a3a-bbf6-490b-99d7-9c8466c0c9ac tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:21:51.882279 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.objects.instance [None req-85907a3a-bbf6-490b-99d7-9c8466c0c9ac tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lazy-loading 'services' on Instance uuid 25c00062-b8e5-4575-a993-bcace67b3682 {{(pid=118344) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 20:21:52.062999 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-85907a3a-bbf6-490b-99d7-9c8466c0c9ac tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] 10.222.0.58 "DELETE /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682/os-volume_attachments/ebabd94a-760a-4408-b95d-719ad87a4103" status: 202 len: 0 microversion: 2.1 time: 0.287578 Jul 21 20:21:52.064002 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 621/1262] 10.222.0.58 () {58 vars in 1415 bytes} [Thu Jul 21 20:21:51 2022] DELETE /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682/os-volume_attachments/ebabd94a-760a-4408-b95d-719ad87a4103 => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 20:21:52.072848 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-c1400499-9870-4b51-a20b-2a6b204f7074 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:21:52.073947 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-c1400499-9870-4b51-a20b-2a6b204f7074 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] [instance: 25c00062-b8e5-4575-a993-bcace67b3682] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:21:52.082697 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c1400499-9870-4b51-a20b-2a6b204f7074 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:21:52.091228 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c1400499-9870-4b51-a20b-2a6b204f7074 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:21:52.091228 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c1400499-9870-4b51-a20b-2a6b204f7074 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:21:52.091228 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c1400499-9870-4b51-a20b-2a6b204f7074 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:21:52.116143 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-c1400499-9870-4b51-a20b-2a6b204f7074 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] 10.222.0.58 "GET /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047615 Jul 21 20:21:52.116716 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 642/1263] 10.222.0.58 () {58 vars in 1301 bytes} [Thu Jul 21 20:21:52 2022] GET /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 20:21:53.128942 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-9f7dee2b-9f75-4400-9505-a0a032b2b521 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:21:53.130012 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-9f7dee2b-9f75-4400-9505-a0a032b2b521 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] [instance: 25c00062-b8e5-4575-a993-bcace67b3682] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:21:53.136859 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-9f7dee2b-9f75-4400-9505-a0a032b2b521 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:21:53.137306 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-9f7dee2b-9f75-4400-9505-a0a032b2b521 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:21:53.138583 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-9f7dee2b-9f75-4400-9505-a0a032b2b521 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:21:53.139033 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-9f7dee2b-9f75-4400-9505-a0a032b2b521 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:21:53.170061 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-9f7dee2b-9f75-4400-9505-a0a032b2b521 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] 10.222.0.58 "GET /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045867 Jul 21 20:21:53.170621 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 622/1264] 10.222.0.58 () {58 vars in 1301 bytes} [Thu Jul 21 20:21:53 2022] GET /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:21:53.770271 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [req-0c6d9b1a-3c8a-4275-b394-d05b27178641 req-ce1a1683-aea2-4cf2-aafd-4cb13d00edea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25c00062-b8e5-4575-a993-bcace67b3682", "tag": "eae9dff4-a338-4cab-b3de-c05350da7fab"}]} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:21:53.778729 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-0c6d9b1a-3c8a-4275-b394-d05b27178641 req-ce1a1683-aea2-4cf2-aafd-4cb13d00edea service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:21:53.779205 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-0c6d9b1a-3c8a-4275-b394-d05b27178641 req-ce1a1683-aea2-4cf2-aafd-4cb13d00edea service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:21:53.789905 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.compute.server_external_events [req-0c6d9b1a-3c8a-4275-b394-d05b27178641 req-ce1a1683-aea2-4cf2-aafd-4cb13d00edea service nova] Creating event network-changed:eae9dff4-a338-4cab-b3de-c05350da7fab for instance 25c00062-b8e5-4575-a993-bcace67b3682 on hv-cinder-85054 Jul 21 20:21:53.795122 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [req-0c6d9b1a-3c8a-4275-b394-d05b27178641 req-ce1a1683-aea2-4cf2-aafd-4cb13d00edea service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027994 Jul 21 20:21:53.795672 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 643/1265] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 20:21:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:21:54.182054 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-e42c6cf3-c594-4514-bb20-83b34cbcd64d tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:21:54.182977 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-e42c6cf3-c594-4514-bb20-83b34cbcd64d tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] [instance: 25c00062-b8e5-4575-a993-bcace67b3682] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:21:54.188813 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG dbcounter [-] [118344] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=118344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:21:54.193674 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-e42c6cf3-c594-4514-bb20-83b34cbcd64d tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:21:54.194125 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-e42c6cf3-c594-4514-bb20-83b34cbcd64d tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:21:54.194896 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-e42c6cf3-c594-4514-bb20-83b34cbcd64d tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:21:54.195366 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-e42c6cf3-c594-4514-bb20-83b34cbcd64d tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:21:54.197892 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG dbcounter [-] [118344] Writing DB stats nova_cell1:SELECT=76,nova_cell1:INSERT=1 {{(pid=118344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:21:54.225296 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-e42c6cf3-c594-4514-bb20-83b34cbcd64d tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] 10.222.0.58 "GET /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047340 Jul 21 20:21:54.225792 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 623/1266] 10.222.0.58 () {58 vars in 1301 bytes} [Thu Jul 21 20:21:54 2022] GET /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 21 20:21:54.236770 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-fcf34e5b-c409-4a44-b451-34d770e0b494 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:21:54.237359 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-fcf34e5b-c409-4a44-b451-34d770e0b494 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] [instance: 25c00062-b8e5-4575-a993-bcace67b3682] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:21:54.243480 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-fcf34e5b-c409-4a44-b451-34d770e0b494 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:21:54.246112 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-fcf34e5b-c409-4a44-b451-34d770e0b494 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:21:54.246112 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-fcf34e5b-c409-4a44-b451-34d770e0b494 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:21:54.246112 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-fcf34e5b-c409-4a44-b451-34d770e0b494 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:21:54.319341 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.wsgi [None req-fcf34e5b-c409-4a44-b451-34d770e0b494 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] HTTP exception thrown: Instance 25c00062-b8e5-4575-a993-bcace67b3682 is not attached to volume ebabd94a-760a-4408-b95d-719ad87a4103 Jul 21 20:21:54.321722 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-fcf34e5b-c409-4a44-b451-34d770e0b494 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Request method failure captured: Jul 21 20:21:54.321722 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: request: DELETE /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682/os-volume_attachments/ebabd94a-760a-4408-b95d-719ad87a4103 HTTP/1.1 Jul 21 20:21:54.321722 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Accept: application/json Jul 21 20:21:54.321722 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Accept-Encoding: identity Jul 21 20:21:54.321722 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Connection: close Jul 21 20:21:54.321722 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Content-Length: 0 Jul 21 20:21:54.321722 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Content-Type: application/json Jul 21 20:21:54.321722 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Host: 10.222.0.58 Jul 21 20:21:54.321722 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Openstack-System-Scope: None Jul 21 20:21:54.321722 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: User-Agent: python-urllib3/1.26.9 Jul 21 20:21:54.321722 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Auth-Token: gAAAAABi2bRpOAkFoEf08b9_mdU_s3JgQwv-Xuqae1lHkhPmlYOy7Qi1N0VXhBq6c5FWKVabOGUMOx2n1bJPlBFPBnd-gLiCa4bFCzbAjl7Qzhl-JnKh4WmWObIOJPaW_Ad5yJYSZLhZtxU6Uc5EPjvqGr_HWuyJgf5ASbE4QhK3yY0UQ4UX6wk Jul 21 20:21:54.321722 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Domain-Id: None Jul 21 20:21:54.321722 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Domain-Name: None Jul 21 20:21:54.321722 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Identity-Status: Confirmed Jul 21 20:21:54.321722 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Is-Admin-Project: True Jul 21 20:21:54.321722 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Id: default Jul 21 20:21:54.321722 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Name: Default Jul 21 20:21:54.321722 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Id: 3c262cd918784d6490dcd78eda61c551 Jul 21 20:21:54.321722 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Name: tempest-TestMinimumBasicScenario-512667749 Jul 21 20:21:54.321722 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Role: reader,member Jul 21 20:21:54.321722 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Roles: reader,member Jul 21 20:21:54.323535 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3c262cd918784d6490dcd78eda61c551"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3c262cd918784d6490dcd78eda61c551"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3c262cd918784d6490dcd78eda61c551"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3c262cd918784d6490dcd78eda61c551"}]}] Jul 21 20:21:54.323535 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Tenant: tempest-TestMinimumBasicScenario-512667749 Jul 21 20:21:54.323535 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Tenant-Id: 3c262cd918784d6490dcd78eda61c551 Jul 21 20:21:54.323535 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Tenant-Name: tempest-TestMinimumBasicScenario-512667749 Jul 21 20:21:54.323535 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User: tempest-TestMinimumBasicScenario-512667749-project Jul 21 20:21:54.323535 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Id: default Jul 21 20:21:54.323535 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Name: Default Jul 21 20:21:54.323535 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Id: 216eb0b454534a878c30a23e9126ff9f Jul 21 20:21:54.323535 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Name: tempest-TestMinimumBasicScenario-512667749-project Jul 21 20:21:54.323535 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: method: > Jul 21 20:21:54.323535 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: exception: Instance 25c00062-b8e5-4575-a993-bcace67b3682 is not attached to volume ebabd94a-760a-4408-b95d-719ad87a4103 Jul 21 20:21:54.324502 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: action_args: {'server_id': '25c00062-b8e5-4575-a993-bcace67b3682', 'id': 'ebabd94a-760a-4408-b95d-719ad87a4103'} Jul 21 20:21:54.324502 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 20:21:54.324502 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:21:54.324502 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 21 20:21:54.324502 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 21 20:21:54.324502 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 21 20:21:54.324502 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 21 20:21:54.324502 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 21 20:21:54.324502 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 21 20:21:54.324502 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id ebabd94a-760a-4408-b95d-719ad87a4103. Jul 21 20:21:54.324502 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:21:54.324502 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:21:54.324502 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:21:54.324502 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:21:54.324502 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:21:54.324502 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:21:54.324502 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 20:21:54.324502 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 20:21:54.324502 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 20:21:54.326679 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 20:21:54.326679 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 21 20:21:54.326679 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 21 20:21:54.326679 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25c00062-b8e5-4575-a993-bcace67b3682 is not attached to volume ebabd94a-760a-4408-b95d-719ad87a4103 Jul 21 20:21:54.326679 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:21:54.326679 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:21:54.326679 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:21:54.326679 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:21:54.326679 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:21:54.326679 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:21:54.326679 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 20:21:54.326679 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 20:21:54.326679 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25c00062-b8e5-4575-a993-bcace67b3682 is not attached to volume ebabd94a-760a-4408-b95d-719ad87a4103 Jul 21 20:21:54.326679 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:21:54.326679 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-fcf34e5b-c409-4a44-b451-34d770e0b494 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Returning 404 to user: Instance 25c00062-b8e5-4575-a993-bcace67b3682 is not attached to volume ebabd94a-760a-4408-b95d-719ad87a4103 {{(pid=118345) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 20:21:54.328495 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-fcf34e5b-c409-4a44-b451-34d770e0b494 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] 10.222.0.58 "DELETE /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682/os-volume_attachments/ebabd94a-760a-4408-b95d-719ad87a4103" status: 404 len: 154 microversion: 2.1 time: 0.091300 Jul 21 20:21:54.328495 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 644/1267] 10.222.0.58 () {58 vars in 1415 bytes} [Thu Jul 21 20:21:54 2022] DELETE /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682/os-volume_attachments/ebabd94a-760a-4408-b95d-719ad87a4103 => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 20:21:55.584150 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-47a202ef-55cc-4c05-9de7-51fe1e0f5c96 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:21:55.584621 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-47a202ef-55cc-4c05-9de7-51fe1e0f5c96 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] [instance: 25c00062-b8e5-4575-a993-bcace67b3682] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:21:55.592624 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-47a202ef-55cc-4c05-9de7-51fe1e0f5c96 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:21:55.593209 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-47a202ef-55cc-4c05-9de7-51fe1e0f5c96 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:21:55.594047 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-47a202ef-55cc-4c05-9de7-51fe1e0f5c96 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:21:55.594472 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-47a202ef-55cc-4c05-9de7-51fe1e0f5c96 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:21:55.620095 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-47a202ef-55cc-4c05-9de7-51fe1e0f5c96 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] [instance: 25c00062-b8e5-4575-a993-bcace67b3682] Going to try to terminate instance {{(pid=118344) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 20:21:55.873750 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-47a202ef-55cc-4c05-9de7-51fe1e0f5c96 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] 10.222.0.58 "DELETE /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682" status: 204 len: 0 microversion: 2.1 time: 0.293765 Jul 21 20:21:55.874331 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 624/1268] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Jul 21 20:21:55 2022] DELETE /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 20:21:55.882603 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-7c33c6ee-df3b-41f9-8cc8-e8de81b52710 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:21:55.883250 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-7c33c6ee-df3b-41f9-8cc8-e8de81b52710 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] [instance: 25c00062-b8e5-4575-a993-bcace67b3682] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:21:55.890346 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-7c33c6ee-df3b-41f9-8cc8-e8de81b52710 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:21:55.890803 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-7c33c6ee-df3b-41f9-8cc8-e8de81b52710 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:21:55.891595 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-7c33c6ee-df3b-41f9-8cc8-e8de81b52710 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:21:55.892024 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-7c33c6ee-df3b-41f9-8cc8-e8de81b52710 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:21:56.022678 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-7c33c6ee-df3b-41f9-8cc8-e8de81b52710 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216eb0b454534a878c30a23e9126ff9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c262cd918784d6490dcd78eda61c551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:21:56.030856 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-7c33c6ee-df3b-41f9-8cc8-e8de81b52710 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] 10.222.0.58 "GET /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682" status: 200 len: 1554 microversion: 2.1 time: 0.152164 Jul 21 20:21:56.031446 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 645/1269] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:21:55 2022] GET /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682 => generated 1554 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:21:57.049105 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-cdf07d00-e64b-4e0e-957b-74c25da79b56 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:21:57.049800 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-cdf07d00-e64b-4e0e-957b-74c25da79b56 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] [instance: 25c00062-b8e5-4575-a993-bcace67b3682] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:21:57.056241 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-cdf07d00-e64b-4e0e-957b-74c25da79b56 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:21:57.056682 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-cdf07d00-e64b-4e0e-957b-74c25da79b56 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:21:57.057436 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-cdf07d00-e64b-4e0e-957b-74c25da79b56 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:21:57.057865 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-cdf07d00-e64b-4e0e-957b-74c25da79b56 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:21:57.192018 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-cdf07d00-e64b-4e0e-957b-74c25da79b56 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216eb0b454534a878c30a23e9126ff9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c262cd918784d6490dcd78eda61c551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:21:57.194444 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-cdf07d00-e64b-4e0e-957b-74c25da79b56 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] 10.222.0.58 "GET /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682" status: 200 len: 1554 microversion: 2.1 time: 0.150258 Jul 21 20:21:57.195011 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 625/1270] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:21:57 2022] GET /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682 => generated 1554 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:21:58.210846 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-725098ba-79dd-4a24-ac24-2cc42978bb17 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:21:58.211484 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-725098ba-79dd-4a24-ac24-2cc42978bb17 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] [instance: 25c00062-b8e5-4575-a993-bcace67b3682] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:21:58.213987 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_api:SELECT=41 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:21:58.218722 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-725098ba-79dd-4a24-ac24-2cc42978bb17 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:21:58.219216 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-725098ba-79dd-4a24-ac24-2cc42978bb17 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:21:58.219982 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-725098ba-79dd-4a24-ac24-2cc42978bb17 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:21:58.220737 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-725098ba-79dd-4a24-ac24-2cc42978bb17 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:21:58.223271 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell1:SELECT=77 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:21:58.348737 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-725098ba-79dd-4a24-ac24-2cc42978bb17 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216eb0b454534a878c30a23e9126ff9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c262cd918784d6490dcd78eda61c551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:21:58.356222 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-725098ba-79dd-4a24-ac24-2cc42978bb17 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] 10.222.0.58 "GET /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682" status: 200 len: 1554 microversion: 2.1 time: 0.149259 Jul 21 20:21:58.356790 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 646/1271] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:21:58 2022] GET /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682 => generated 1554 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:21:58.905068 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [req-012e4a3b-a9a5-4575-93a9-667771e87f7d req-bb567819-0183-4e28-b4ea-53c80a41c145 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25c00062-b8e5-4575-a993-bcace67b3682", "name": "network-vif-deleted", "tag": "eae9dff4-a338-4cab-b3de-c05350da7fab"}]} {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:21:58.913616 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [req-012e4a3b-a9a5-4575-93a9-667771e87f7d req-bb567819-0183-4e28-b4ea-53c80a41c145 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:21:58.914058 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [req-012e4a3b-a9a5-4575-93a9-667771e87f7d req-bb567819-0183-4e28-b4ea-53c80a41c145 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:21:58.925197 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.compute.server_external_events [req-012e4a3b-a9a5-4575-93a9-667771e87f7d req-bb567819-0183-4e28-b4ea-53c80a41c145 service nova] Creating event network-vif-deleted:eae9dff4-a338-4cab-b3de-c05350da7fab for instance 25c00062-b8e5-4575-a993-bcace67b3682 on hv-cinder-85054 Jul 21 20:21:58.930007 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [req-012e4a3b-a9a5-4575-93a9-667771e87f7d req-bb567819-0183-4e28-b4ea-53c80a41c145 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028732 Jul 21 20:21:58.930578 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 626/1272] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 20:21:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 20:21:59.372980 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-4956d019-d31c-4df4-806d-a9ceda938c9e tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:21:59.373589 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-4956d019-d31c-4df4-806d-a9ceda938c9e tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] [instance: 25c00062-b8e5-4575-a993-bcace67b3682] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:21:59.380495 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4956d019-d31c-4df4-806d-a9ceda938c9e tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:21:59.380935 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4956d019-d31c-4df4-806d-a9ceda938c9e tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:21:59.381687 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4956d019-d31c-4df4-806d-a9ceda938c9e tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:21:59.382114 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4956d019-d31c-4df4-806d-a9ceda938c9e tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:21:59.416633 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4956d019-d31c-4df4-806d-a9ceda938c9e tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:21:59.417070 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4956d019-d31c-4df4-806d-a9ceda938c9e tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:21:59.417505 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.objects.instance [None req-4956d019-d31c-4df4-806d-a9ceda938c9e tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lazy-loading 'fault' on Instance uuid 25c00062-b8e5-4575-a993-bcace67b3682 {{(pid=118345) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 20:21:59.464787 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-4956d019-d31c-4df4-806d-a9ceda938c9e tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216eb0b454534a878c30a23e9126ff9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c262cd918784d6490dcd78eda61c551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:21:59.473544 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-4956d019-d31c-4df4-806d-a9ceda938c9e tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] 10.222.0.58 "GET /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682" status: 200 len: 1348 microversion: 2.1 time: 0.104596 Jul 21 20:21:59.474106 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 647/1273] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:21:59 2022] GET /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682 => generated 1348 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:22:00.492480 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-f6eefd5e-518e-4249-a597-ea67b3506dc5 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:22:00.493183 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-f6eefd5e-518e-4249-a597-ea67b3506dc5 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] [instance: 25c00062-b8e5-4575-a993-bcace67b3682] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:22:00.500073 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f6eefd5e-518e-4249-a597-ea67b3506dc5 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:22:00.500526 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f6eefd5e-518e-4249-a597-ea67b3506dc5 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:22:00.501293 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f6eefd5e-518e-4249-a597-ea67b3506dc5 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:22:00.501731 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f6eefd5e-518e-4249-a597-ea67b3506dc5 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:22:00.514990 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.wsgi [None req-f6eefd5e-518e-4249-a597-ea67b3506dc5 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] HTTP exception thrown: Instance 25c00062-b8e5-4575-a993-bcace67b3682 could not be found. Jul 21 20:22:00.516665 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-f6eefd5e-518e-4249-a597-ea67b3506dc5 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Request method failure captured: Jul 21 20:22:00.516665 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: request: GET /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682 HTTP/1.1 Jul 21 20:22:00.516665 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Accept: application/json Jul 21 20:22:00.516665 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Accept-Encoding: identity Jul 21 20:22:00.516665 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Connection: close Jul 21 20:22:00.516665 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Content-Length: 0 Jul 21 20:22:00.516665 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Content-Type: application/json Jul 21 20:22:00.516665 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Host: 10.222.0.58 Jul 21 20:22:00.516665 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Openstack-System-Scope: None Jul 21 20:22:00.516665 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: User-Agent: python-urllib3/1.26.9 Jul 21 20:22:00.516665 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Auth-Token: gAAAAABi2bRpOAkFoEf08b9_mdU_s3JgQwv-Xuqae1lHkhPmlYOy7Qi1N0VXhBq6c5FWKVabOGUMOx2n1bJPlBFPBnd-gLiCa4bFCzbAjl7Qzhl-JnKh4WmWObIOJPaW_Ad5yJYSZLhZtxU6Uc5EPjvqGr_HWuyJgf5ASbE4QhK3yY0UQ4UX6wk Jul 21 20:22:00.516665 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Domain-Id: None Jul 21 20:22:00.516665 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Domain-Name: None Jul 21 20:22:00.516665 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Identity-Status: Confirmed Jul 21 20:22:00.516665 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Is-Admin-Project: True Jul 21 20:22:00.516665 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Domain-Id: default Jul 21 20:22:00.516665 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Domain-Name: Default Jul 21 20:22:00.516665 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Id: 3c262cd918784d6490dcd78eda61c551 Jul 21 20:22:00.516665 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Name: tempest-TestMinimumBasicScenario-512667749 Jul 21 20:22:00.516665 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Role: reader,member Jul 21 20:22:00.516665 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Roles: reader,member Jul 21 20:22:00.518425 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3c262cd918784d6490dcd78eda61c551"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3c262cd918784d6490dcd78eda61c551"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3c262cd918784d6490dcd78eda61c551"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3c262cd918784d6490dcd78eda61c551"}]}] Jul 21 20:22:00.518425 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Tenant: tempest-TestMinimumBasicScenario-512667749 Jul 21 20:22:00.518425 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Tenant-Id: 3c262cd918784d6490dcd78eda61c551 Jul 21 20:22:00.518425 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Tenant-Name: tempest-TestMinimumBasicScenario-512667749 Jul 21 20:22:00.518425 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User: tempest-TestMinimumBasicScenario-512667749-project Jul 21 20:22:00.518425 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Domain-Id: default Jul 21 20:22:00.518425 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Domain-Name: Default Jul 21 20:22:00.518425 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Id: 216eb0b454534a878c30a23e9126ff9f Jul 21 20:22:00.518425 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Name: tempest-TestMinimumBasicScenario-512667749-project Jul 21 20:22:00.518425 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: method: > Jul 21 20:22:00.518425 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: exception: Instance 25c00062-b8e5-4575-a993-bcace67b3682 could not be found. Jul 21 20:22:00.518425 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: action_args: {'id': '25c00062-b8e5-4575-a993-bcace67b3682'} Jul 21 20:22:00.519560 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 20:22:00.519560 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:22:00.519560 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 20:22:00.519560 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 20:22:00.519560 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 20:22:00.519560 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 20:22:00.519560 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 20:22:00.519560 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 20:22:00.519560 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 20:22:00.519560 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 20:22:00.519560 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25c00062-b8e5-4575-a993-bcace67b3682 could not be found. Jul 21 20:22:00.519560 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:22:00.519560 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:22:00.519560 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:22:00.519560 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:22:00.519560 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:22:00.519560 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:22:00.519560 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 20:22:00.519560 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 20:22:00.519560 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 20:22:00.521218 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 20:22:00.521218 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 20:22:00.521218 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 20:22:00.521218 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 20:22:00.521218 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 20:22:00.521218 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 20:22:00.521218 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 20:22:00.521218 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25c00062-b8e5-4575-a993-bcace67b3682 could not be found. Jul 21 20:22:00.521218 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:22:00.521218 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:22:00.521218 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:22:00.521218 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:22:00.521218 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:22:00.521218 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:22:00.521218 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 20:22:00.521218 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 20:22:00.521218 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25c00062-b8e5-4575-a993-bcace67b3682 could not be found. Jul 21 20:22:00.521218 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:22:00.522694 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-f6eefd5e-518e-4249-a597-ea67b3506dc5 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Returning 404 to user: Instance 25c00062-b8e5-4575-a993-bcace67b3682 could not be found. {{(pid=118344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 20:22:00.522694 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-f6eefd5e-518e-4249-a597-ea67b3506dc5 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] 10.222.0.58 "GET /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682" status: 404 len: 111 microversion: 2.1 time: 0.030431 Jul 21 20:22:00.522694 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 627/1274] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:22:00 2022] GET /compute/v2.1/servers/25c00062-b8e5-4575-a993-bcace67b3682 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 20:22:00.526868 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-fee99631-5e49-44bd-ae1f-a31af8b7e6e7 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] Calling method '.version_select at 0x7f351ccacee0>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:22:00.589063 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-fee99631-5e49-44bd-ae1f-a31af8b7e6e7 tempest-TestMinimumBasicScenario-512667749 tempest-TestMinimumBasicScenario-512667749-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-732270295" status: 202 len: 0 microversion: 2.1 time: 0.066205 Jul 21 20:22:00.589652 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 648/1275] 10.222.0.58 () {58 vars in 1268 bytes} [Thu Jul 21 20:22:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-732270295 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 20:23:12.517572 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 20:23:12.518198 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Thu Jul 21 20:23:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 20:23:20.263890 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 20:23:20.264508 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Thu Jul 21 20:23:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 20:23:52.944571 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG dbcounter [-] [118344] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1 {{(pid=118344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:23:52.944571 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG dbcounter [-] [118344] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:23:52.945127 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell1:SELECT=13 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:23:52.945127 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_api:SELECT=8,nova_api:DELETE=1 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:23:52.945613 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-f4f4c98b-d13f-4d10-9c36-41cfad7554de tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:23:52.945613 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-f4f4c98b-d13f-4d10-9c36-41cfad7554de tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] [instance: 4aad6915-17c7-42b8-8439-56a088c8d8c3] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:23:52.951631 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f4f4c98b-d13f-4d10-9c36-41cfad7554de tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:23:52.952080 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f4f4c98b-d13f-4d10-9c36-41cfad7554de tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:23:52.952868 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f4f4c98b-d13f-4d10-9c36-41cfad7554de tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:23:52.953304 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-f4f4c98b-d13f-4d10-9c36-41cfad7554de tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:23:52.981033 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-f4f4c98b-d13f-4d10-9c36-41cfad7554de tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] [instance: 4aad6915-17c7-42b8-8439-56a088c8d8c3] Going to try to terminate instance {{(pid=118344) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 20:23:53.103995 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [req-08d2c190-f2d6-49cf-a691-21041beb4f7c req-654ffca0-f771-4077-a7e6-1b1b39f51d89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4aad6915-17c7-42b8-8439-56a088c8d8c3", "tag": "482aade5-ab2e-4d3f-9ec5-abb78514eeaf"}]} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:23:53.117101 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-08d2c190-f2d6-49cf-a691-21041beb4f7c req-654ffca0-f771-4077-a7e6-1b1b39f51d89 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:23:53.117547 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-08d2c190-f2d6-49cf-a691-21041beb4f7c req-654ffca0-f771-4077-a7e6-1b1b39f51d89 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:23:53.129556 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.compute.server_external_events [req-08d2c190-f2d6-49cf-a691-21041beb4f7c req-654ffca0-f771-4077-a7e6-1b1b39f51d89 service nova] Creating event network-changed:482aade5-ab2e-4d3f-9ec5-abb78514eeaf for instance 4aad6915-17c7-42b8-8439-56a088c8d8c3 on hv-cinder-85054 Jul 21 20:23:53.134908 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [req-08d2c190-f2d6-49cf-a691-21041beb4f7c req-654ffca0-f771-4077-a7e6-1b1b39f51d89 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.196346 Jul 21 20:23:53.137757 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 649/1276] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 20:23:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:23:53.300723 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-f4f4c98b-d13f-4d10-9c36-41cfad7554de tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] 10.222.0.58 "DELETE /compute/v2.1/servers/4aad6915-17c7-42b8-8439-56a088c8d8c3" status: 204 len: 0 microversion: 2.1 time: 0.364494 Jul 21 20:23:53.301641 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 628/1277] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Jul 21 20:23:52 2022] DELETE /compute/v2.1/servers/4aad6915-17c7-42b8-8439-56a088c8d8c3 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 20:23:53.310547 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-de4d7244-22ce-4432-beb9-79f544811099 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:23:53.311300 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-de4d7244-22ce-4432-beb9-79f544811099 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] [instance: 4aad6915-17c7-42b8-8439-56a088c8d8c3] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:23:53.319133 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-de4d7244-22ce-4432-beb9-79f544811099 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:23:53.319587 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-de4d7244-22ce-4432-beb9-79f544811099 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:23:53.320363 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-de4d7244-22ce-4432-beb9-79f544811099 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:23:53.320804 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-de4d7244-22ce-4432-beb9-79f544811099 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:23:53.464865 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-de4d7244-22ce-4432-beb9-79f544811099 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4460571d9294e38931274a55c6c5857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a259cf4b240fba9b065a43b2ed4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:23:53.473405 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-de4d7244-22ce-4432-beb9-79f544811099 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] 10.222.0.58 "GET /compute/v2.1/servers/4aad6915-17c7-42b8-8439-56a088c8d8c3" status: 200 len: 1577 microversion: 2.1 time: 0.167354 Jul 21 20:23:53.473922 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 650/1278] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:23:53 2022] GET /compute/v2.1/servers/4aad6915-17c7-42b8-8439-56a088c8d8c3 => generated 1577 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:23:54.493808 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-ae05c504-0be6-4e59-830c-e2ebf2abcfff tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:23:54.494502 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-ae05c504-0be6-4e59-830c-e2ebf2abcfff tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] [instance: 4aad6915-17c7-42b8-8439-56a088c8d8c3] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:23:54.501776 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-ae05c504-0be6-4e59-830c-e2ebf2abcfff tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:23:54.502224 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-ae05c504-0be6-4e59-830c-e2ebf2abcfff tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:23:54.502995 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-ae05c504-0be6-4e59-830c-e2ebf2abcfff tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:23:54.503459 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-ae05c504-0be6-4e59-830c-e2ebf2abcfff tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:23:54.716956 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-ae05c504-0be6-4e59-830c-e2ebf2abcfff tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4460571d9294e38931274a55c6c5857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a259cf4b240fba9b065a43b2ed4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:23:54.725305 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-ae05c504-0be6-4e59-830c-e2ebf2abcfff tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] 10.222.0.58 "GET /compute/v2.1/servers/4aad6915-17c7-42b8-8439-56a088c8d8c3" status: 200 len: 1577 microversion: 2.1 time: 0.236305 Jul 21 20:23:54.725934 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 629/1279] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:23:54 2022] GET /compute/v2.1/servers/4aad6915-17c7-42b8-8439-56a088c8d8c3 => generated 1577 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:23:55.745112 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-73f1415b-c163-4d14-a4f1-6de287155e27 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:23:55.745495 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-73f1415b-c163-4d14-a4f1-6de287155e27 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] [instance: 4aad6915-17c7-42b8-8439-56a088c8d8c3] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:23:55.756837 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-73f1415b-c163-4d14-a4f1-6de287155e27 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:23:55.756837 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-73f1415b-c163-4d14-a4f1-6de287155e27 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:23:55.756837 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-73f1415b-c163-4d14-a4f1-6de287155e27 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:23:55.756837 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-73f1415b-c163-4d14-a4f1-6de287155e27 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:23:55.816416 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [req-4adef534-e6e7-4821-9b2b-ff5ee652e48b req-a30b5277-c287-4a4a-8fd7-db0708a0905a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4aad6915-17c7-42b8-8439-56a088c8d8c3", "name": "network-vif-deleted", "tag": "482aade5-ab2e-4d3f-9ec5-abb78514eeaf"}]} {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:23:55.830494 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-73f1415b-c163-4d14-a4f1-6de287155e27 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4460571d9294e38931274a55c6c5857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a259cf4b240fba9b065a43b2ed4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:23:55.830737 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [req-4adef534-e6e7-4821-9b2b-ff5ee652e48b req-a30b5277-c287-4a4a-8fd7-db0708a0905a service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:23:55.830737 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [req-4adef534-e6e7-4821-9b2b-ff5ee652e48b req-a30b5277-c287-4a4a-8fd7-db0708a0905a service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:23:55.833240 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-73f1415b-c163-4d14-a4f1-6de287155e27 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] 10.222.0.58 "GET /compute/v2.1/servers/4aad6915-17c7-42b8-8439-56a088c8d8c3" status: 200 len: 1390 microversion: 2.1 time: 0.093663 Jul 21 20:23:55.833838 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 651/1280] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:23:55 2022] GET /compute/v2.1/servers/4aad6915-17c7-42b8-8439-56a088c8d8c3 => generated 1390 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:23:55.837143 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.compute.server_external_events [req-4adef534-e6e7-4821-9b2b-ff5ee652e48b req-a30b5277-c287-4a4a-8fd7-db0708a0905a service nova] Creating event network-vif-deleted:482aade5-ab2e-4d3f-9ec5-abb78514eeaf for instance 4aad6915-17c7-42b8-8439-56a088c8d8c3 on hv-cinder-85054 Jul 21 20:23:55.842119 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [req-4adef534-e6e7-4821-9b2b-ff5ee652e48b req-a30b5277-c287-4a4a-8fd7-db0708a0905a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029527 Jul 21 20:23:55.842695 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 630/1281] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 20:23:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 20:23:56.852378 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-2ad9587a-9cc4-4a70-8d31-ebe66052dcdf tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:23:56.852991 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-2ad9587a-9cc4-4a70-8d31-ebe66052dcdf tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] [instance: 4aad6915-17c7-42b8-8439-56a088c8d8c3] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:23:56.860138 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2ad9587a-9cc4-4a70-8d31-ebe66052dcdf tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:23:56.860793 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2ad9587a-9cc4-4a70-8d31-ebe66052dcdf tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:23:56.861574 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2ad9587a-9cc4-4a70-8d31-ebe66052dcdf tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:23:56.862651 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2ad9587a-9cc4-4a70-8d31-ebe66052dcdf tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:23:56.893902 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2ad9587a-9cc4-4a70-8d31-ebe66052dcdf tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:23:56.894352 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2ad9587a-9cc4-4a70-8d31-ebe66052dcdf tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:23:56.894799 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.objects.instance [None req-2ad9587a-9cc4-4a70-8d31-ebe66052dcdf tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lazy-loading 'fault' on Instance uuid 4aad6915-17c7-42b8-8439-56a088c8d8c3 {{(pid=118345) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 20:23:56.935901 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-2ad9587a-9cc4-4a70-8d31-ebe66052dcdf tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4460571d9294e38931274a55c6c5857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a259cf4b240fba9b065a43b2ed4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:23:56.943782 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-2ad9587a-9cc4-4a70-8d31-ebe66052dcdf tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] 10.222.0.58 "GET /compute/v2.1/servers/4aad6915-17c7-42b8-8439-56a088c8d8c3" status: 200 len: 1229 microversion: 2.1 time: 0.095306 Jul 21 20:23:56.944348 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 652/1282] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:23:56 2022] GET /compute/v2.1/servers/4aad6915-17c7-42b8-8439-56a088c8d8c3 => generated 1229 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:23:57.962364 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-c18eabf4-9ba0-40bf-9b1c-c36671b9da3e tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:23:57.963013 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-c18eabf4-9ba0-40bf-9b1c-c36671b9da3e tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] [instance: 4aad6915-17c7-42b8-8439-56a088c8d8c3] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:23:57.969295 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-c18eabf4-9ba0-40bf-9b1c-c36671b9da3e tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:23:57.969743 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-c18eabf4-9ba0-40bf-9b1c-c36671b9da3e tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:23:57.970756 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-c18eabf4-9ba0-40bf-9b1c-c36671b9da3e tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:23:57.971237 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-c18eabf4-9ba0-40bf-9b1c-c36671b9da3e tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:23:57.984147 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.wsgi [None req-c18eabf4-9ba0-40bf-9b1c-c36671b9da3e tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] HTTP exception thrown: Instance 4aad6915-17c7-42b8-8439-56a088c8d8c3 could not be found. Jul 21 20:23:57.985737 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-c18eabf4-9ba0-40bf-9b1c-c36671b9da3e tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Request method failure captured: Jul 21 20:23:57.985737 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: request: GET /compute/v2.1/servers/4aad6915-17c7-42b8-8439-56a088c8d8c3 HTTP/1.1 Jul 21 20:23:57.985737 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Accept: application/json Jul 21 20:23:57.985737 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Accept-Encoding: identity Jul 21 20:23:57.985737 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Connection: close Jul 21 20:23:57.985737 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Content-Length: 0 Jul 21 20:23:57.985737 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Content-Type: application/json Jul 21 20:23:57.985737 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Host: 10.222.0.58 Jul 21 20:23:57.985737 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Openstack-System-Scope: None Jul 21 20:23:57.985737 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: User-Agent: python-urllib3/1.26.9 Jul 21 20:23:57.985737 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Auth-Token: gAAAAABi2bOyAPgMcq3UH_A-sF4JTb4-D2XU515CwZP3flz-yPGmNuW-WbHKMutbYGqceV-QgEIrlFw_80cA596KMvmuSaIhtFCFUyelSoS3JtQvR1SMSP71XOPqUd2JDsIi9zeasDxPosQ0GqiMCZVtz97NrODEp36WiJ7sAT0X0R-B26KjBqY Jul 21 20:23:57.985737 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Domain-Id: None Jul 21 20:23:57.985737 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Domain-Name: None Jul 21 20:23:57.985737 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Identity-Status: Confirmed Jul 21 20:23:57.985737 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Is-Admin-Project: True Jul 21 20:23:57.985737 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Domain-Id: default Jul 21 20:23:57.985737 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Domain-Name: Default Jul 21 20:23:57.985737 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Id: 997a259cf4b240fba9b065a43b2ed4fc Jul 21 20:23:57.985737 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Name: tempest-TestVolumeBootPattern-647171023 Jul 21 20:23:57.985737 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Role: reader,member Jul 21 20:23:57.985737 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Roles: reader,member Jul 21 20:23:57.988050 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/997a259cf4b240fba9b065a43b2ed4fc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/997a259cf4b240fba9b065a43b2ed4fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_997a259cf4b240fba9b065a43b2ed4fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/997a259cf4b240fba9b065a43b2ed4fc"}]}] Jul 21 20:23:57.988050 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Tenant: tempest-TestVolumeBootPattern-647171023 Jul 21 20:23:57.988050 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Tenant-Id: 997a259cf4b240fba9b065a43b2ed4fc Jul 21 20:23:57.988050 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Tenant-Name: tempest-TestVolumeBootPattern-647171023 Jul 21 20:23:57.988050 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User: tempest-TestVolumeBootPattern-647171023-project Jul 21 20:23:57.988050 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Domain-Id: default Jul 21 20:23:57.988050 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Domain-Name: Default Jul 21 20:23:57.988050 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Id: c4460571d9294e38931274a55c6c5857 Jul 21 20:23:57.988050 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Name: tempest-TestVolumeBootPattern-647171023-project Jul 21 20:23:57.988050 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: method: > Jul 21 20:23:57.988050 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: exception: Instance 4aad6915-17c7-42b8-8439-56a088c8d8c3 could not be found. Jul 21 20:23:57.988050 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: action_args: {'id': '4aad6915-17c7-42b8-8439-56a088c8d8c3'} Jul 21 20:23:57.989140 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 20:23:57.989140 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:23:57.989140 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 20:23:57.989140 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 20:23:57.989140 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 20:23:57.989140 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 20:23:57.989140 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 20:23:57.989140 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 20:23:57.989140 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 20:23:57.989140 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 20:23:57.989140 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4aad6915-17c7-42b8-8439-56a088c8d8c3 could not be found. Jul 21 20:23:57.989140 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:23:57.989140 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:23:57.989140 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:23:57.989140 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:23:57.989140 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:23:57.989140 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:23:57.989140 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 20:23:57.989140 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 20:23:57.989140 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 20:23:57.990844 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 20:23:57.990844 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 20:23:57.990844 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 20:23:57.990844 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 20:23:57.990844 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 20:23:57.990844 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 20:23:57.990844 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 20:23:57.990844 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4aad6915-17c7-42b8-8439-56a088c8d8c3 could not be found. Jul 21 20:23:57.990844 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:23:57.990844 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:23:57.990844 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:23:57.990844 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:23:57.990844 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:23:57.990844 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:23:57.990844 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 20:23:57.990844 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 20:23:57.990844 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4aad6915-17c7-42b8-8439-56a088c8d8c3 could not be found. Jul 21 20:23:57.990844 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:23:57.992428 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-c18eabf4-9ba0-40bf-9b1c-c36671b9da3e tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Returning 404 to user: Instance 4aad6915-17c7-42b8-8439-56a088c8d8c3 could not be found. {{(pid=118344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 20:23:57.992428 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-c18eabf4-9ba0-40bf-9b1c-c36671b9da3e tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] 10.222.0.58 "GET /compute/v2.1/servers/4aad6915-17c7-42b8-8439-56a088c8d8c3" status: 404 len: 111 microversion: 2.1 time: 0.029625 Jul 21 20:23:57.992428 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 631/1283] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:23:57 2022] GET /compute/v2.1/servers/4aad6915-17c7-42b8-8439-56a088c8d8c3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 20:24:01.292438 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-2c0d9011-9f06-455f-b847-29818695a32d tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:24:01.296279 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-2c0d9011-9f06-455f-b847-29818695a32d tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] [instance: 15930e99-4a7e-48c9-be0d-5b3d91fb044c] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:24:01.296415 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [req-fb8020ee-dde1-45f0-91d1-90338064eb81 req-425d3259-13fb-4e49-b5fb-dfde6a452538 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15930e99-4a7e-48c9-be0d-5b3d91fb044c", "tag": "fc62afdf-aa2c-456a-b4bd-d7f4981ec4d3"}]} {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:24:01.300103 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2c0d9011-9f06-455f-b847-29818695a32d tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:24:01.301657 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2c0d9011-9f06-455f-b847-29818695a32d tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:24:01.302480 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2c0d9011-9f06-455f-b847-29818695a32d tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:24:01.302919 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2c0d9011-9f06-455f-b847-29818695a32d tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:24:01.304646 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [req-fb8020ee-dde1-45f0-91d1-90338064eb81 req-425d3259-13fb-4e49-b5fb-dfde6a452538 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:24:01.305273 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [req-fb8020ee-dde1-45f0-91d1-90338064eb81 req-425d3259-13fb-4e49-b5fb-dfde6a452538 service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:24:01.317678 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.compute.server_external_events [req-fb8020ee-dde1-45f0-91d1-90338064eb81 req-425d3259-13fb-4e49-b5fb-dfde6a452538 service nova] Creating event network-changed:fc62afdf-aa2c-456a-b4bd-d7f4981ec4d3 for instance 15930e99-4a7e-48c9-be0d-5b3d91fb044c on hv-cinder-85054 Jul 21 20:24:01.322955 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [req-fb8020ee-dde1-45f0-91d1-90338064eb81 req-425d3259-13fb-4e49-b5fb-dfde6a452538 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031646 Jul 21 20:24:01.324752 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 632/1284] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 20:24:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:24:01.332026 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-2c0d9011-9f06-455f-b847-29818695a32d tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] [instance: 15930e99-4a7e-48c9-be0d-5b3d91fb044c] Going to try to terminate instance {{(pid=118345) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 20:24:01.614238 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-2c0d9011-9f06-455f-b847-29818695a32d tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] 10.222.0.58 "DELETE /compute/v2.1/servers/15930e99-4a7e-48c9-be0d-5b3d91fb044c" status: 204 len: 0 microversion: 2.1 time: 0.325615 Jul 21 20:24:01.614855 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 653/1285] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Jul 21 20:24:01 2022] DELETE /compute/v2.1/servers/15930e99-4a7e-48c9-be0d-5b3d91fb044c => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 20:24:01.628221 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-3e1d41da-0d6c-4986-b12d-2fbacd279d4d tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:24:01.628959 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-3e1d41da-0d6c-4986-b12d-2fbacd279d4d tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] [instance: 15930e99-4a7e-48c9-be0d-5b3d91fb044c] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:24:01.635536 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-3e1d41da-0d6c-4986-b12d-2fbacd279d4d tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:24:01.635985 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-3e1d41da-0d6c-4986-b12d-2fbacd279d4d tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:24:01.638260 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-3e1d41da-0d6c-4986-b12d-2fbacd279d4d tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:24:01.638260 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-3e1d41da-0d6c-4986-b12d-2fbacd279d4d tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:24:01.777865 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.policy [None req-3e1d41da-0d6c-4986-b12d-2fbacd279d4d tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4460571d9294e38931274a55c6c5857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a259cf4b240fba9b065a43b2ed4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118344) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:24:01.795557 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-3e1d41da-0d6c-4986-b12d-2fbacd279d4d tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] 10.222.0.58 "GET /compute/v2.1/servers/15930e99-4a7e-48c9-be0d-5b3d91fb044c" status: 200 len: 1577 microversion: 2.1 time: 0.175716 Jul 21 20:24:01.796158 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 633/1286] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:24:01 2022] GET /compute/v2.1/servers/15930e99-4a7e-48c9-be0d-5b3d91fb044c => generated 1577 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:24:02.814089 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-2263e78a-bde6-4474-90b9-ab2b95790978 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:24:02.814818 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-2263e78a-bde6-4474-90b9-ab2b95790978 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] [instance: 15930e99-4a7e-48c9-be0d-5b3d91fb044c] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:24:02.821602 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2263e78a-bde6-4474-90b9-ab2b95790978 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:24:02.822140 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2263e78a-bde6-4474-90b9-ab2b95790978 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:24:02.822973 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2263e78a-bde6-4474-90b9-ab2b95790978 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:24:02.823452 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2263e78a-bde6-4474-90b9-ab2b95790978 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:24:02.957217 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-2263e78a-bde6-4474-90b9-ab2b95790978 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4460571d9294e38931274a55c6c5857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a259cf4b240fba9b065a43b2ed4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:24:02.965165 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-2263e78a-bde6-4474-90b9-ab2b95790978 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] 10.222.0.58 "GET /compute/v2.1/servers/15930e99-4a7e-48c9-be0d-5b3d91fb044c" status: 200 len: 1458 microversion: 2.1 time: 0.155339 Jul 21 20:24:02.965739 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 654/1287] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:24:02 2022] GET /compute/v2.1/servers/15930e99-4a7e-48c9-be0d-5b3d91fb044c => generated 1458 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:24:03.051411 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [req-d4724180-5f5f-4824-8deb-921c05f1b4e9 req-74858874-8488-4d40-be28-023f96a5709c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15930e99-4a7e-48c9-be0d-5b3d91fb044c", "name": "network-vif-deleted", "tag": "fc62afdf-aa2c-456a-b4bd-d7f4981ec4d3"}]} {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:24:03.059945 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [req-d4724180-5f5f-4824-8deb-921c05f1b4e9 req-74858874-8488-4d40-be28-023f96a5709c service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:24:03.060382 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [req-d4724180-5f5f-4824-8deb-921c05f1b4e9 req-74858874-8488-4d40-be28-023f96a5709c service nova] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:24:03.071100 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.compute.server_external_events [req-d4724180-5f5f-4824-8deb-921c05f1b4e9 req-74858874-8488-4d40-be28-023f96a5709c service nova] Creating event network-vif-deleted:fc62afdf-aa2c-456a-b4bd-d7f4981ec4d3 for instance 15930e99-4a7e-48c9-be0d-5b3d91fb044c on hv-cinder-85054 Jul 21 20:24:03.075654 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [req-d4724180-5f5f-4824-8deb-921c05f1b4e9 req-74858874-8488-4d40-be28-023f96a5709c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028678 Jul 21 20:24:03.076219 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 634/1288] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 20:24:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 20:24:03.983406 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-a3a24b78-71ce-4a04-9bff-56b3d4dccd1f tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:24:03.984024 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-a3a24b78-71ce-4a04-9bff-56b3d4dccd1f tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] [instance: 15930e99-4a7e-48c9-be0d-5b3d91fb044c] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:24:03.991127 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a3a24b78-71ce-4a04-9bff-56b3d4dccd1f tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:24:03.991577 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a3a24b78-71ce-4a04-9bff-56b3d4dccd1f tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:24:03.992349 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a3a24b78-71ce-4a04-9bff-56b3d4dccd1f tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:24:03.992784 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a3a24b78-71ce-4a04-9bff-56b3d4dccd1f tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:24:04.023403 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a3a24b78-71ce-4a04-9bff-56b3d4dccd1f tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:24:04.023844 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a3a24b78-71ce-4a04-9bff-56b3d4dccd1f tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:24:04.024292 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.objects.instance [None req-a3a24b78-71ce-4a04-9bff-56b3d4dccd1f tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lazy-loading 'fault' on Instance uuid 15930e99-4a7e-48c9-be0d-5b3d91fb044c {{(pid=118345) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 20:24:04.070092 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-a3a24b78-71ce-4a04-9bff-56b3d4dccd1f tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4460571d9294e38931274a55c6c5857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a259cf4b240fba9b065a43b2ed4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:24:04.077692 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-a3a24b78-71ce-4a04-9bff-56b3d4dccd1f tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] 10.222.0.58 "GET /compute/v2.1/servers/15930e99-4a7e-48c9-be0d-5b3d91fb044c" status: 200 len: 1229 microversion: 2.1 time: 0.098413 Jul 21 20:24:04.078250 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 655/1289] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:24:03 2022] GET /compute/v2.1/servers/15930e99-4a7e-48c9-be0d-5b3d91fb044c => generated 1229 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:24:05.096113 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-dd977998-4d57-4202-b8f7-8ed057143e7b tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:24:05.096993 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-dd977998-4d57-4202-b8f7-8ed057143e7b tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] [instance: 15930e99-4a7e-48c9-be0d-5b3d91fb044c] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:24:05.103206 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-dd977998-4d57-4202-b8f7-8ed057143e7b tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:24:05.103656 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-dd977998-4d57-4202-b8f7-8ed057143e7b tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:24:05.104416 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-dd977998-4d57-4202-b8f7-8ed057143e7b tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:24:05.104846 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-dd977998-4d57-4202-b8f7-8ed057143e7b tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:24:05.117894 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.wsgi [None req-dd977998-4d57-4202-b8f7-8ed057143e7b tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] HTTP exception thrown: Instance 15930e99-4a7e-48c9-be0d-5b3d91fb044c could not be found. Jul 21 20:24:05.119545 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-dd977998-4d57-4202-b8f7-8ed057143e7b tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Request method failure captured: Jul 21 20:24:05.119545 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: request: GET /compute/v2.1/servers/15930e99-4a7e-48c9-be0d-5b3d91fb044c HTTP/1.1 Jul 21 20:24:05.119545 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Accept: application/json Jul 21 20:24:05.119545 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Accept-Encoding: identity Jul 21 20:24:05.119545 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Connection: close Jul 21 20:24:05.119545 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Content-Length: 0 Jul 21 20:24:05.119545 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Content-Type: application/json Jul 21 20:24:05.119545 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Host: 10.222.0.58 Jul 21 20:24:05.119545 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Openstack-System-Scope: None Jul 21 20:24:05.119545 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: User-Agent: python-urllib3/1.26.9 Jul 21 20:24:05.119545 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Auth-Token: gAAAAABi2bOyAPgMcq3UH_A-sF4JTb4-D2XU515CwZP3flz-yPGmNuW-WbHKMutbYGqceV-QgEIrlFw_80cA596KMvmuSaIhtFCFUyelSoS3JtQvR1SMSP71XOPqUd2JDsIi9zeasDxPosQ0GqiMCZVtz97NrODEp36WiJ7sAT0X0R-B26KjBqY Jul 21 20:24:05.119545 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Domain-Id: None Jul 21 20:24:05.119545 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Domain-Name: None Jul 21 20:24:05.119545 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Identity-Status: Confirmed Jul 21 20:24:05.119545 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Is-Admin-Project: True Jul 21 20:24:05.119545 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Domain-Id: default Jul 21 20:24:05.119545 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Domain-Name: Default Jul 21 20:24:05.119545 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Id: 997a259cf4b240fba9b065a43b2ed4fc Jul 21 20:24:05.119545 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Name: tempest-TestVolumeBootPattern-647171023 Jul 21 20:24:05.119545 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Role: reader,member Jul 21 20:24:05.119545 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Roles: reader,member Jul 21 20:24:05.121231 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/997a259cf4b240fba9b065a43b2ed4fc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/997a259cf4b240fba9b065a43b2ed4fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_997a259cf4b240fba9b065a43b2ed4fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/997a259cf4b240fba9b065a43b2ed4fc"}]}] Jul 21 20:24:05.121231 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Tenant: tempest-TestVolumeBootPattern-647171023 Jul 21 20:24:05.121231 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Tenant-Id: 997a259cf4b240fba9b065a43b2ed4fc Jul 21 20:24:05.121231 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Tenant-Name: tempest-TestVolumeBootPattern-647171023 Jul 21 20:24:05.121231 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User: tempest-TestVolumeBootPattern-647171023-project Jul 21 20:24:05.121231 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Domain-Id: default Jul 21 20:24:05.121231 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Domain-Name: Default Jul 21 20:24:05.121231 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Id: c4460571d9294e38931274a55c6c5857 Jul 21 20:24:05.121231 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Name: tempest-TestVolumeBootPattern-647171023-project Jul 21 20:24:05.121231 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: method: > Jul 21 20:24:05.121231 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: exception: Instance 15930e99-4a7e-48c9-be0d-5b3d91fb044c could not be found. Jul 21 20:24:05.121231 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: action_args: {'id': '15930e99-4a7e-48c9-be0d-5b3d91fb044c'} Jul 21 20:24:05.122212 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 20:24:05.122212 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:24:05.122212 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 20:24:05.122212 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 20:24:05.122212 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 20:24:05.122212 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 20:24:05.122212 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 20:24:05.122212 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 20:24:05.122212 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 20:24:05.122212 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 20:24:05.122212 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15930e99-4a7e-48c9-be0d-5b3d91fb044c could not be found. Jul 21 20:24:05.122212 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:24:05.122212 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:24:05.122212 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:24:05.122212 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:24:05.122212 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:24:05.122212 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:24:05.122212 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 20:24:05.122212 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 20:24:05.122212 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 20:24:05.123891 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 20:24:05.123891 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 20:24:05.123891 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 20:24:05.123891 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 20:24:05.123891 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 20:24:05.123891 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 20:24:05.123891 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 20:24:05.123891 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15930e99-4a7e-48c9-be0d-5b3d91fb044c could not be found. Jul 21 20:24:05.123891 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:24:05.123891 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:24:05.123891 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:24:05.123891 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:24:05.123891 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:24:05.123891 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:24:05.123891 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 20:24:05.123891 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 20:24:05.123891 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15930e99-4a7e-48c9-be0d-5b3d91fb044c could not be found. Jul 21 20:24:05.123891 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:24:05.125540 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-dd977998-4d57-4202-b8f7-8ed057143e7b tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Returning 404 to user: Instance 15930e99-4a7e-48c9-be0d-5b3d91fb044c could not be found. {{(pid=118344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 20:24:05.125540 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-dd977998-4d57-4202-b8f7-8ed057143e7b tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] 10.222.0.58 "GET /compute/v2.1/servers/15930e99-4a7e-48c9-be0d-5b3d91fb044c" status: 404 len: 111 microversion: 2.1 time: 0.029846 Jul 21 20:24:05.125540 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 635/1290] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:24:05 2022] GET /compute/v2.1/servers/15930e99-4a7e-48c9-be0d-5b3d91fb044c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 20:24:05.643936 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-1434058a-4392-4c1b-a404-6dc78a860541 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:24:05.644489 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-1434058a-4392-4c1b-a404-6dc78a860541 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] [instance: 80714390-c8b6-4703-a02a-d41fafad3540] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:24:05.651227 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1434058a-4392-4c1b-a404-6dc78a860541 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:24:05.651675 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1434058a-4392-4c1b-a404-6dc78a860541 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:24:05.652438 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1434058a-4392-4c1b-a404-6dc78a860541 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:24:05.652869 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1434058a-4392-4c1b-a404-6dc78a860541 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:24:05.665921 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.wsgi [None req-1434058a-4392-4c1b-a404-6dc78a860541 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] HTTP exception thrown: Instance 80714390-c8b6-4703-a02a-d41fafad3540 could not be found. Jul 21 20:24:05.667634 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-1434058a-4392-4c1b-a404-6dc78a860541 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Request method failure captured: Jul 21 20:24:05.667634 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: request: DELETE /compute/v2.1/servers/80714390-c8b6-4703-a02a-d41fafad3540 HTTP/1.1 Jul 21 20:24:05.667634 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Accept: application/json Jul 21 20:24:05.667634 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Accept-Encoding: identity Jul 21 20:24:05.667634 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Connection: close Jul 21 20:24:05.667634 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Content-Length: 0 Jul 21 20:24:05.667634 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Content-Type: application/json Jul 21 20:24:05.667634 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Host: 10.222.0.58 Jul 21 20:24:05.667634 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Openstack-System-Scope: None Jul 21 20:24:05.667634 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: User-Agent: python-urllib3/1.26.9 Jul 21 20:24:05.667634 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Auth-Token: gAAAAABi2bOyAPgMcq3UH_A-sF4JTb4-D2XU515CwZP3flz-yPGmNuW-WbHKMutbYGqceV-QgEIrlFw_80cA596KMvmuSaIhtFCFUyelSoS3JtQvR1SMSP71XOPqUd2JDsIi9zeasDxPosQ0GqiMCZVtz97NrODEp36WiJ7sAT0X0R-B26KjBqY Jul 21 20:24:05.667634 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Domain-Id: None Jul 21 20:24:05.667634 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Domain-Name: None Jul 21 20:24:05.667634 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Identity-Status: Confirmed Jul 21 20:24:05.667634 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Is-Admin-Project: True Jul 21 20:24:05.667634 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Id: default Jul 21 20:24:05.667634 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Name: Default Jul 21 20:24:05.667634 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Id: 997a259cf4b240fba9b065a43b2ed4fc Jul 21 20:24:05.667634 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Project-Name: tempest-TestVolumeBootPattern-647171023 Jul 21 20:24:05.667634 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Role: reader,member Jul 21 20:24:05.667634 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Roles: reader,member Jul 21 20:24:05.669479 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/997a259cf4b240fba9b065a43b2ed4fc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/997a259cf4b240fba9b065a43b2ed4fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_997a259cf4b240fba9b065a43b2ed4fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/997a259cf4b240fba9b065a43b2ed4fc"}]}] Jul 21 20:24:05.669479 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Tenant: tempest-TestVolumeBootPattern-647171023 Jul 21 20:24:05.669479 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Tenant-Id: 997a259cf4b240fba9b065a43b2ed4fc Jul 21 20:24:05.669479 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-Tenant-Name: tempest-TestVolumeBootPattern-647171023 Jul 21 20:24:05.669479 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User: tempest-TestVolumeBootPattern-647171023-project Jul 21 20:24:05.669479 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Id: default Jul 21 20:24:05.669479 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Name: Default Jul 21 20:24:05.669479 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Id: c4460571d9294e38931274a55c6c5857 Jul 21 20:24:05.669479 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: X-User-Name: tempest-TestVolumeBootPattern-647171023-project Jul 21 20:24:05.669479 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: method: > Jul 21 20:24:05.669479 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: exception: Instance 80714390-c8b6-4703-a02a-d41fafad3540 could not be found. Jul 21 20:24:05.669479 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: action_args: {'id': '80714390-c8b6-4703-a02a-d41fafad3540'} Jul 21 20:24:05.670518 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 20:24:05.670518 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:24:05.670518 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 20:24:05.670518 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 20:24:05.670518 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 20:24:05.670518 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 20:24:05.670518 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 20:24:05.670518 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 20:24:05.670518 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 20:24:05.670518 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 20:24:05.670518 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80714390-c8b6-4703-a02a-d41fafad3540 could not be found. Jul 21 20:24:05.670518 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:24:05.670518 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:24:05.670518 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:24:05.670518 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:24:05.670518 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:24:05.670518 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:24:05.670518 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 20:24:05.670518 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 20:24:05.670518 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 20:24:05.674258 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 20:24:05.674258 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 20:24:05.674258 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 20:24:05.674258 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 20:24:05.674258 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 20:24:05.674258 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 20:24:05.674258 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 20:24:05.674258 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 20:24:05.674258 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 20:24:05.674258 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80714390-c8b6-4703-a02a-d41fafad3540 could not be found. Jul 21 20:24:05.674258 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:24:05.674258 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:24:05.674258 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:24:05.674258 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:24:05.674258 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:24:05.674258 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:24:05.674258 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 20:24:05.674258 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 20:24:05.674258 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80714390-c8b6-4703-a02a-d41fafad3540 could not be found. Jul 21 20:24:05.674258 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jul 21 20:24:05.676663 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-1434058a-4392-4c1b-a404-6dc78a860541 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Returning 404 to user: Instance 80714390-c8b6-4703-a02a-d41fafad3540 could not be found. {{(pid=118345) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 20:24:05.676663 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-1434058a-4392-4c1b-a404-6dc78a860541 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] 10.222.0.58 "DELETE /compute/v2.1/servers/80714390-c8b6-4703-a02a-d41fafad3540" status: 404 len: 111 microversion: 2.1 time: 0.029074 Jul 21 20:24:05.676663 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 656/1291] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Jul 21 20:24:05 2022] DELETE /compute/v2.1/servers/80714390-c8b6-4703-a02a-d41fafad3540 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 20:24:05.681101 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-76b76785-0bea-470e-93c5-48ffea1db70f tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Calling method '>' {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:24:05.681712 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.compute.api [None req-76b76785-0bea-470e-93c5-48ffea1db70f tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] [instance: 80714390-c8b6-4703-a02a-d41fafad3540] Fetching instance by UUID {{(pid=118344) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:24:05.687782 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-76b76785-0bea-470e-93c5-48ffea1db70f tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:24:05.688236 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-76b76785-0bea-470e-93c5-48ffea1db70f tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:24:05.689335 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-76b76785-0bea-470e-93c5-48ffea1db70f tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:24:05.689888 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG oslo_concurrency.lockutils [None req-76b76785-0bea-470e-93c5-48ffea1db70f tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Lock "c67a2928-fd99-4ffe-bc44-a4ed319a28fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:24:05.703747 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.wsgi [None req-76b76785-0bea-470e-93c5-48ffea1db70f tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] HTTP exception thrown: Instance 80714390-c8b6-4703-a02a-d41fafad3540 could not be found. Jul 21 20:24:05.705279 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-76b76785-0bea-470e-93c5-48ffea1db70f tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Request method failure captured: Jul 21 20:24:05.705279 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: request: GET /compute/v2.1/servers/80714390-c8b6-4703-a02a-d41fafad3540 HTTP/1.1 Jul 21 20:24:05.705279 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Accept: application/json Jul 21 20:24:05.705279 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Accept-Encoding: identity Jul 21 20:24:05.705279 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Connection: close Jul 21 20:24:05.705279 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Content-Length: 0 Jul 21 20:24:05.705279 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Content-Type: application/json Jul 21 20:24:05.705279 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Host: 10.222.0.58 Jul 21 20:24:05.705279 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Openstack-System-Scope: None Jul 21 20:24:05.705279 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: User-Agent: python-urllib3/1.26.9 Jul 21 20:24:05.705279 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Auth-Token: gAAAAABi2bOyAPgMcq3UH_A-sF4JTb4-D2XU515CwZP3flz-yPGmNuW-WbHKMutbYGqceV-QgEIrlFw_80cA596KMvmuSaIhtFCFUyelSoS3JtQvR1SMSP71XOPqUd2JDsIi9zeasDxPosQ0GqiMCZVtz97NrODEp36WiJ7sAT0X0R-B26KjBqY Jul 21 20:24:05.705279 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Domain-Id: None Jul 21 20:24:05.705279 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Domain-Name: None Jul 21 20:24:05.705279 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Identity-Status: Confirmed Jul 21 20:24:05.705279 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Is-Admin-Project: True Jul 21 20:24:05.705279 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Domain-Id: default Jul 21 20:24:05.705279 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Domain-Name: Default Jul 21 20:24:05.705279 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Id: 997a259cf4b240fba9b065a43b2ed4fc Jul 21 20:24:05.705279 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Project-Name: tempest-TestVolumeBootPattern-647171023 Jul 21 20:24:05.705279 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Role: reader,member Jul 21 20:24:05.705279 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Roles: reader,member Jul 21 20:24:05.706957 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/997a259cf4b240fba9b065a43b2ed4fc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/997a259cf4b240fba9b065a43b2ed4fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_997a259cf4b240fba9b065a43b2ed4fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/997a259cf4b240fba9b065a43b2ed4fc"}]}] Jul 21 20:24:05.706957 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Tenant: tempest-TestVolumeBootPattern-647171023 Jul 21 20:24:05.706957 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Tenant-Id: 997a259cf4b240fba9b065a43b2ed4fc Jul 21 20:24:05.706957 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-Tenant-Name: tempest-TestVolumeBootPattern-647171023 Jul 21 20:24:05.706957 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User: tempest-TestVolumeBootPattern-647171023-project Jul 21 20:24:05.706957 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Domain-Id: default Jul 21 20:24:05.706957 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Domain-Name: Default Jul 21 20:24:05.706957 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Id: c4460571d9294e38931274a55c6c5857 Jul 21 20:24:05.706957 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: X-User-Name: tempest-TestVolumeBootPattern-647171023-project Jul 21 20:24:05.706957 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: method: > Jul 21 20:24:05.706957 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: exception: Instance 80714390-c8b6-4703-a02a-d41fafad3540 could not be found. Jul 21 20:24:05.706957 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: action_args: {'id': '80714390-c8b6-4703-a02a-d41fafad3540'} Jul 21 20:24:05.708015 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: {{(pid=118344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 20:24:05.708015 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:24:05.708015 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 20:24:05.708015 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 20:24:05.708015 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 20:24:05.708015 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 20:24:05.708015 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 20:24:05.708015 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 20:24:05.708015 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 20:24:05.708015 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 20:24:05.708015 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80714390-c8b6-4703-a02a-d41fafad3540 could not be found. Jul 21 20:24:05.708015 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:24:05.708015 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:24:05.708015 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:24:05.708015 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:24:05.708015 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:24:05.708015 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:24:05.708015 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 20:24:05.708015 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 20:24:05.708015 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 20:24:05.709635 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 20:24:05.709635 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 20:24:05.709635 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 20:24:05.709635 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 20:24:05.709635 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 20:24:05.709635 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 20:24:05.709635 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 20:24:05.709635 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80714390-c8b6-4703-a02a-d41fafad3540 could not be found. Jul 21 20:24:05.709635 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:24:05.709635 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:24:05.709635 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:24:05.709635 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:24:05.709635 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:24:05.709635 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:24:05.709635 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 20:24:05.709635 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 20:24:05.709635 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80714390-c8b6-4703-a02a-d41fafad3540 could not be found. Jul 21 20:24:05.709635 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: ERROR nova.api.openstack.wsgi Jul 21 20:24:05.711161 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: DEBUG nova.api.openstack.wsgi [None req-76b76785-0bea-470e-93c5-48ffea1db70f tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Returning 404 to user: Instance 80714390-c8b6-4703-a02a-d41fafad3540 could not be found. {{(pid=118344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 20:24:05.711161 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO nova.api.openstack.requestlog [None req-76b76785-0bea-470e-93c5-48ffea1db70f tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] 10.222.0.58 "GET /compute/v2.1/servers/80714390-c8b6-4703-a02a-d41fafad3540" status: 404 len: 111 microversion: 2.1 time: 0.029495 Jul 21 20:24:05.711161 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: [pid: 118344|app: 0|req: 636/1292] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 20:24:05 2022] GET /compute/v2.1/servers/80714390-c8b6-4703-a02a-d41fafad3540 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 20:24:07.166765 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-53d353a6-a027-4153-a915-c6ff33311786 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] Calling method '.version_select at 0x7f351d097dc0>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:24:07.238136 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-53d353a6-a027-4153-a915-c6ff33311786 tempest-TestVolumeBootPattern-647171023 tempest-TestVolumeBootPattern-647171023-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1032901572" status: 202 len: 0 microversion: 2.1 time: 0.074591 Jul 21 20:24:07.238772 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 657/1293] 10.222.0.58 () {58 vars in 1262 bytes} [Thu Jul 21 20:24:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1032901572 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 20:26:32.525845 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 20:26:32.526486 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Thu Jul 21 20:26:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 20:26:35.476473 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 20:26:35.476943 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Thu Jul 21 20:26:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 20:26:40.272827 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 20:26:40.273477 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Thu Jul 21 20:26:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 20:26:42.881290 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 20:26:42.881795 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Thu Jul 21 20:26:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 20:26:58.681654 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 20:26:58.682206 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Thu Jul 21 20:26:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 20:26:59.564714 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 20:26:59.565297 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Thu Jul 21 20:26:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 20:29:52.534131 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 20:29:52.534752 dv-cinder-850548-2-iscsi devstack@n-api.service[118344]: Thu Jul 21 20:29:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 20:29:55.484298 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 20:29:55.484871 dv-cinder-850548-2-iscsi devstack@n-api.service[118345]: Thu Jul 21 20:29:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!